2021-08-03T10:29:39.658 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-08-03T10:29:39.660 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi/6309289 --owner scheduled_kchai@teuthology --name kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} -- /home/teuthworker/archive/kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi/6309289/orig.config.yaml 2021-08-03T10:29:39.702 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-08-03T10:29:39.752 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi/6309289 branch: wip-kefu-testing2-2021-08-03-1601 description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} email: null first_in_suite: false job_id: '6309289' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: '8.3' overrides: admin_socket: branch: wip-kefu-testing2-2021-08-03-1601 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(OSDMAP_FLAGS\) - \(SMALLER_PGP_NUM\) - \(POOL_APP_NOT_ENABLED\) - \(SLOW OPS\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: df0bf89fcfd3db43ce7267598c7265ea8975a515 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: debuginfo: true sha1: df0bf89fcfd3db43ce7267598c7265ea8975a515 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-kefu-testing2-2021-08-03-1601 sha1: df0bf89fcfd3db43ce7267598c7265ea8975a515 owner: scheduled_kchai@teuthology priority: 60 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: df0bf89fcfd3db43ce7267598c7265ea8975a515 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing2-2021-08-03-1601 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_df0bf89fcfd3db43ce7267598c7265ea8975a515/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: df0bf89fcfd3db43ce7267598c7265ea8975a515 targets: smithi003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeCeLu/MKw3M9U/b5QFNlhrXRS8VhUntsaF5R7BeaqCmAIN9oAVPXGrfrSRDuB3vROLWhvyQE112du2Shod0lZrzjmed1v9IDkJSMkYq3AoB48tgN/jIyZZaywgQMgcozx5fgtGKx4HKNUy2YgYhnILTPt+pbVjUWTVhwmCtRCG1Fmto3S1VTk7c0VYGF89fGmAeo0JjRiHaBJQ2Z/I0m63A7IckwgGDaNIlNn/BiL+zg4e4JWK+Pt9o5qpmQsYy3B26V9T7ZQXhD2EU7sqLLfKJkusdEjfgCX1/J/S7L/ZsD+26ESJIzAT/x4Fkby+I5SReIStn6yssZtpXWq3FOSCD4JmIAoNEGMSoN5ODd93wR/NnJQkhwNhvDOdXoxFYPVLOZ4zkmtggq8vD0zB769C6a7gdnVoPYDPA8Vs74D49V+rNxqFlsdEqZ/zm9ty7gagI9NSCjpo90cgPRXwy16zxKzIuMSdCK6EJV82U/mgkYlgXVJDUpoxWSmnGe/IzE= smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8VxFem3KORPrPo/3k95i0ENIYzOGChPkzxRV6tmWI3vTKyXYFQNibEvLyWMlVrOXPSX7pDMKp+EUhgcC5TK9sWU/0nYbeKEINIE/kC+KIeOHBIZd7K3e1aSij2aefnYzppX+rLIIRCrP5YEXsNtFRi4A0PvI6GQH0KRZKysSlhOad3MUE5HYodj467uIS6FDfwopukPxgaByJtl85s502bvlPTT1Wak1yAcgSCsvhj4J86l9V+B/F62SLwRThSg3b4G/BrUaK7Na65qjTFVE+qAJ4SszdIFmAoWZLosfspCfRp3ccpqhevXYbWMuTTw7JveTpT56gExOAB1D8lZ6Hdt1hrv5xTV1HowadicaA4w6yUAUHd8he9u4kNa0zG+pyaxvuJk7t6xPs1aRzsDXP3UbzmbG6wTQq7wo7o/mTtRWTC4IvXRmN6quTl4WYy4koJrzNRUCOuorHc1azcJ8jvY+LVsLIQUjkbRIrwUwY5KEcM/FgpcsDtgxeIL101k8= tasks: - install: null - ceph: null - thrashosds: chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - mon_recovery: null teuthology_branch: master teuthology_sha1: 73aa7e3b960c7ffac669297b6aa86606265edd1b timestamp: 2021-08-03_10:14:51 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 2021-08-03T10:29:39.753 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_df0bf89fcfd3db43ce7267598c7265ea8975a515/qa; will attempt to use it 2021-08-03T10:29:39.753 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_df0bf89fcfd3db43ce7267598c7265ea8975a515/qa/tasks 2021-08-03T10:29:39.754 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-08-03T10:29:39.756 INFO:teuthology.task.internal:Checking packages... 2021-08-03T10:29:39.777 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'df0bf89fcfd3db43ce7267598c7265ea8975a515' 2021-08-03T10:29:39.777 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-08-03T10:29:39.778 INFO:teuthology.packaging:ref: None 2021-08-03T10:29:39.778 INFO:teuthology.packaging:tag: None 2021-08-03T10:29:39.778 INFO:teuthology.packaging:branch: wip-kefu-testing2-2021-08-03-1601 2021-08-03T10:29:39.779 INFO:teuthology.packaging:sha1: df0bf89fcfd3db43ce7267598c7265ea8975a515 2021-08-03T10:29:39.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-kefu-testing2-2021-08-03-1601 2021-08-03T10:29:39.944 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-6630.gdf0bf89f 2021-08-03T10:29:39.944 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-08-03T10:29:39.953 INFO:teuthology.task.internal:no buildpackages task found 2021-08-03T10:29:39.953 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-08-03T10:29:39.984 INFO:teuthology.task.internal:Saving configuration 2021-08-03T10:29:39.997 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-08-03T10:29:40.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-03T10:29:40.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-08-03 10:24:46.684133', 'description': '/home/teuthworker/archive/kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi/6309289', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhH+m3Ote65gCDAYD7AGuQmaBrfRcHUq1nO4lXzpXJNcDPe/QY20CeRtuQAfnmXr2O2TmkG8fxs3NHwpBSY6O0=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi003.front.sepia.ceph.com'} 2021-08-03T10:29:40.039 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-08-03 10:24:46.684112', 'description': '/home/teuthworker/archive/kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi/6309289', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNMwOOPusuUuw6Poas09u7xsoOwgq1g7aw0GCryKaHXAMXVGSPdKOoX1bd3H95sKlBH6otcENcmMs3OH66qWREY=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi101.front.sepia.ceph.com'} 2021-08-03T10:29:40.039 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-08-03T10:29:40.052 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-08-03T10:29:40.052 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-08-03T10:29:40.053 INFO:teuthology.run_tasks:Running task console_log... 2021-08-03T10:29:40.109 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbe7460dc80>, signals=[15]) 2021-08-03T10:29:40.110 INFO:teuthology.run_tasks:Running task internal.connect... 2021-08-03T10:29:40.121 INFO:teuthology.task.internal:Opening connections... 2021-08-03T10:29:40.122 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:29:40.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:29:40.199 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:29:40.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:29:40.270 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-08-03T10:29:40.282 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2021-08-03T10:29:40.330 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2021-08-03T10:29:40.330 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2021-08-03T10:29:40.385 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Linux" 2021-08-03T10:29:40.385 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2021-08-03T10:29:40.385 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2021-08-03T10:29:40.386 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2021-08-03T10:29:40.386 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2021-08-03T10:29:40.386 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2021-08-03T10:29:40.386 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Linux 8" 2021-08-03T10:29:40.387 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2021-08-03T10:29:40.387 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-08-03T10:29:40.387 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2021-08-03T10:29:40.387 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-08-03T10:29:40.388 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-08-03T10:29:40.388 INFO:teuthology.orchestra.run.smithi003.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-08-03T10:29:40.389 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2021-08-03T10:29:40.409 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2021-08-03T10:29:40.424 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2021-08-03T10:29:40.425 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2021-08-03T10:29:40.479 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Linux" 2021-08-03T10:29:40.479 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8" 2021-08-03T10:29:40.479 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2021-08-03T10:29:40.480 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2021-08-03T10:29:40.480 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8" 2021-08-03T10:29:40.480 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2021-08-03T10:29:40.480 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Linux 8" 2021-08-03T10:29:40.481 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2021-08-03T10:29:40.481 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-08-03T10:29:40.481 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2021-08-03T10:29:40.481 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-08-03T10:29:40.482 INFO:teuthology.orchestra.run.smithi101.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-08-03T10:29:40.482 INFO:teuthology.orchestra.run.smithi101.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-08-03T10:29:40.482 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2021-08-03T10:29:40.497 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-08-03T10:29:40.511 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-08-03T10:29:40.525 INFO:teuthology.task.internal:Checking for old test directory... 2021-08-03T10:29:40.526 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2021-08-03T10:29:40.529 DEBUG:teuthology.orchestra.run.smithi101:> test '!' -e /home/ubuntu/cephtest 2021-08-03T10:29:40.542 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-08-03T10:29:40.553 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-08-03T10:29:40.554 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2021-08-03T10:29:40.583 DEBUG:teuthology.orchestra.run.smithi101:> test -z $(ls -A /var/lib/ceph) 2021-08-03T10:29:40.613 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-08-03T10:29:40.658 INFO:teuthology.run_tasks:Running task kernel... 2021-08-03T10:29:40.676 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-08-03T10:29:40.677 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-08-03T10:29:40.677 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2021-08-03T10:29:40.692 INFO:teuthology.orchestra.run.smithi003.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-08-03T10:29:40.693 INFO:teuthology.task.kernel:Running kernel on smithi003: 4.18.0-240.10.1.el8_3.x86_64 2021-08-03T10:29:40.693 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2021-08-03T10:29:43.662 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - AppStream 43 MB/s | 8.3 MB 00:00 2021-08-03T10:29:45.140 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Base 37 MB/s | 4.5 MB 00:00 2021-08-03T10:29:45.881 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Extras 149 kB/s | 10 kB 00:00 2021-08-03T10:29:48.732 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - AppStream 3.0 MB/s | 8.3 MB 00:02 2021-08-03T10:29:51.184 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - BaseOS 4.7 MB/s | 4.5 MB 00:00 2021-08-03T10:29:52.342 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - Extras 21 kB/s | 10 kB 00:00 2021-08-03T10:29:53.343 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 11 MB/s | 10 MB 00:00 2021-08-03T10:29:55.632 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-08-03T10:29:57.400 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-08-03T10:29:57.401 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-08-03T10:29:57.680 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:29:57.698 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:29:57.698 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:29:57.699 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:29:57.699 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:29:57.699 INFO:teuthology.orchestra.run.smithi003.stdout: kernel x86_64 4.18.0-305.10.2.el8_4 CentOS-Base 5.9 M 2021-08-03T10:29:57.699 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:29:57.699 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core x86_64 4.18.0-305.10.2.el8_4 CentOS-Base 36 M 2021-08-03T10:29:57.700 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules x86_64 4.18.0-305.10.2.el8_4 CentOS-Base 28 M 2021-08-03T10:29:57.700 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:29:57.700 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:29:57.700 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:29:57.701 INFO:teuthology.orchestra.run.smithi003.stdout:Install 3 Packages 2021-08-03T10:29:57.701 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:29:57.702 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 70 M 2021-08-03T10:29:57.702 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 88 M 2021-08-03T10:29:57.702 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:29:57.841 INFO:teuthology.orchestra.run.smithi003.stdout:(1/3): kernel-4.18.0-305.10.2.el8_4.x86_64.rpm 42 MB/s | 5.9 MB 00:00 2021-08-03T10:29:58.656 INFO:teuthology.orchestra.run.smithi003.stdout:(2/3): kernel-core-4.18.0-305.10.2.el8_4.x86_64 37 MB/s | 36 MB 00:00 2021-08-03T10:29:58.862 INFO:teuthology.orchestra.run.smithi003.stdout:(3/3): kernel-modules-4.18.0-305.10.2.el8_4.x86 24 MB/s | 28 MB 00:01 2021-08-03T10:29:58.866 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:29:58.866 INFO:teuthology.orchestra.run.smithi003.stdout:Total 60 MB/s | 70 MB 00:01 2021-08-03T10:29:58.984 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:29:59.331 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:29:59.331 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:30:00.556 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:30:00.578 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:30:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:30:03.596 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-core-4.18.0-305.10.2.el8_4.x86_64 1/3 2021-08-03T10:30:06.866 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-4.18.0-305.10.2.el8_4.x86_64 1/3 2021-08-03T10:30:07.177 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-4.18.0-305.10.2.el8_4.x86_64 2/3 2021-08-03T10:30:10.365 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-4.18.0-305.10.2.el8_4.x86_64 2/3 2021-08-03T10:30:10.616 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:30:32.654 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:30:32.957 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:30:32.957 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-4.18.0-305.10.2.el8_4.x86_64 1/3 2021-08-03T10:30:32.957 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-core-4.18.0-305.10.2.el8_4.x86_64 2/3 2021-08-03T10:30:33.261 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:30:33.261 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:30:34.145 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:30:34.145 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:30:34.145 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:30:34.146 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:30:34.146 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:30:34.146 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:30:34.146 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:30:34.220 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel --last | head -n 1 2021-08-03T10:30:34.364 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-4.18.0-305.10.2.el8_4.x86_64 Tue 03 Aug 2021 10:30:10 AM UTC 2021-08-03T10:30:34.366 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:30:34.367 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:30:34.367 DEBUG:teuthology.orchestra.run.smithi101:> uname -r 2021-08-03T10:30:34.385 INFO:teuthology.orchestra.run.smithi101.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-08-03T10:30:34.385 INFO:teuthology.task.kernel:Running kernel on smithi101: 4.18.0-240.10.1.el8_3.x86_64 2021-08-03T10:30:34.385 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum install -y kernel 2021-08-03T10:30:37.556 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS-8 - AppStream 25 MB/s | 8.3 MB 00:00 2021-08-03T10:30:38.941 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS-8 - Base 39 MB/s | 4.5 MB 00:00 2021-08-03T10:30:39.635 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS-8 - Extras 159 kB/s | 10 kB 00:00 2021-08-03T10:30:41.675 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Linux 8 - AppStream 4.2 MB/s | 8.3 MB 00:01 2021-08-03T10:30:44.014 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Linux 8 - BaseOS 4.3 MB/s | 4.5 MB 00:01 2021-08-03T10:30:45.222 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Linux 8 - Extras 18 kB/s | 10 kB 00:00 2021-08-03T10:30:46.008 INFO:teuthology.orchestra.run.smithi101.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-08-03T10:30:48.127 INFO:teuthology.orchestra.run.smithi101.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2021-08-03T10:30:49.815 INFO:teuthology.orchestra.run.smithi101.stdout:Package kernel-4.18.0-240.10.1.el8_3.x86_64 is already installed. 2021-08-03T10:30:49.816 INFO:teuthology.orchestra.run.smithi101.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-08-03T10:30:50.082 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:30:50.095 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:30:50.095 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:30:50.095 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:30:50.095 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:30:50.096 INFO:teuthology.orchestra.run.smithi101.stdout: kernel x86_64 4.18.0-305.10.2.el8_4 CentOS-Base 5.9 M 2021-08-03T10:30:50.096 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:30:50.096 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-core x86_64 4.18.0-305.10.2.el8_4 CentOS-Base 36 M 2021-08-03T10:30:50.096 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-modules x86_64 4.18.0-305.10.2.el8_4 CentOS-Base 28 M 2021-08-03T10:30:50.097 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:30:50.097 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:30:50.097 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:30:50.097 INFO:teuthology.orchestra.run.smithi101.stdout:Install 3 Packages 2021-08-03T10:30:50.097 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:30:50.098 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 70 M 2021-08-03T10:30:50.099 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 88 M 2021-08-03T10:30:50.099 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:30:50.239 INFO:teuthology.orchestra.run.smithi101.stdout:(1/3): kernel-4.18.0-305.10.2.el8_4.x86_64.rpm 41 MB/s | 5.9 MB 00:00 2021-08-03T10:30:50.933 INFO:teuthology.orchestra.run.smithi101.stdout:(2/3): kernel-modules-4.18.0-305.10.2.el8_4.x86 34 MB/s | 28 MB 00:00 2021-08-03T10:30:51.154 INFO:teuthology.orchestra.run.smithi101.stdout:(3/3): kernel-core-4.18.0-305.10.2.el8_4.x86_64 34 MB/s | 36 MB 00:01 2021-08-03T10:30:51.158 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:30:51.158 INFO:teuthology.orchestra.run.smithi101.stdout:Total 66 MB/s | 70 MB 00:01 2021-08-03T10:30:51.268 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:30:51.600 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:30:51.600 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:30:52.826 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:30:52.839 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:30:55.228 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:30:55.698 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : kernel-core-4.18.0-305.10.2.el8_4.x86_64 1/3 2021-08-03T10:30:58.838 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-core-4.18.0-305.10.2.el8_4.x86_64 1/3 2021-08-03T10:30:59.472 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : kernel-modules-4.18.0-305.10.2.el8_4.x86_64 2/3 2021-08-03T10:31:02.437 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-modules-4.18.0-305.10.2.el8_4.x86_64 2/3 2021-08-03T10:31:02.643 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : kernel-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:31:22.931 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-core-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:31:23.230 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: kernel-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:31:23.231 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : kernel-4.18.0-305.10.2.el8_4.x86_64 1/3 2021-08-03T10:31:23.231 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : kernel-core-4.18.0-305.10.2.el8_4.x86_64 2/3 2021-08-03T10:31:23.520 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : kernel-modules-4.18.0-305.10.2.el8_4.x86_64 3/3 2021-08-03T10:31:23.521 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:31:23.870 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:31:23.870 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:31:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-core-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: kernel-modules-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:23.871 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:31:23.871 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:31:23.944 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q kernel --last | head -n 1 2021-08-03T10:31:24.092 INFO:teuthology.orchestra.run.smithi101.stdout:kernel-4.18.0-305.10.2.el8_4.x86_64 Tue 03 Aug 2021 10:31:02 AM UTC 2021-08-03T10:31:24.094 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:24.094 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-240.10.1.el8_3.x86_64 Expected: 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:24.095 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-08-03T10:31:24.095 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-08-03T10:31:24.095 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-08-03T10:31:24.096 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-08-03T10:31:24.096 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2021-08-03T10:31:24.096 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel --last | head -n 1 2021-08-03T10:31:24.230 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-4.18.0-305.10.2.el8_4.x86_64 Tue 03 Aug 2021 10:30:10 AM UTC 2021-08-03T10:31:24.231 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:24.232 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2021-08-03T10:31:24.264 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2021-08-03T10:31:24.265 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2021-08-03T10:31:24.265 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.02 2021-08-03T10:31:24.265 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 90.el8 2021-08-03T10:31:24.265 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2021-08-03T10:31:24.266 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Mon 01 Mar 2021 06:17:56 PM UTC 2021-08-03T10:31:24.266 INFO:teuthology.orchestra.run.smithi003.stdout:Group : System Environment/Base 2021-08-03T10:31:24.266 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 9197207 2021-08-03T10:31:24.266 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2021-08-03T10:31:24.267 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-08-03T10:31:24.267 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-08-03T10:31:24.267 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-08-03T10:31:24.267 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : kbuilder.bsys.centos.org 2021-08-03T10:31:24.268 INFO:teuthology.orchestra.run.smithi003.stdout:Relocations : (not relocatable) 2021-08-03T10:31:24.268 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : CentOS BuildSystem 2021-08-03T10:31:24.268 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2021-08-03T10:31:24.268 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2021-08-03T10:31:24.269 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2021-08-03T10:31:24.269 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2021-08-03T10:31:24.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:31:24.269 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-08-03T10:31:24.270 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2021-08-03T10:31:24.270 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2021-08-03T10:31:24.270 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2021-08-03T10:31:24.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:31:24.271 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2021-08-03T10:31:24.272 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-08-03T10:31:24.272 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:24.273 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-08-03T10:31:25.314 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2021-08-03T10:31:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:done 2021-08-03T10:31:27.266 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2021-08-03T10:31:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.c4RhheFg5k 2021-08-03T10:31:27.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.c4RhheFg5k 2021-08-03T10:31:27.374 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.c4RhheFg5k 2021-08-03T10:31:27.525 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.c4RhheFg5k is 6KB 2021-08-03T10:31:27.575 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.c4RhheFg5k 2021-08-03T10:31:27.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2021-08-03T10:31:27.660 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-0-rescue.conf 2021-08-03T10:31:27.660 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.10.1.el8_3.x86_64.conf 2021-08-03T10:31:27.661 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.el8.x86_64.conf 2021-08-03T10:31:27.661 INFO:teuthology.orchestra.run.smithi003.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-305.10.2.el8_4.x86_64.conf 2021-08-03T10:31:27.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default 631d84db90f7409fbdd390573ae89718-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:27.837 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2021-08-03T10:31:27.839 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-08-03T10:31:27.840 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi101.front.sepia.ceph.com, path=None, version=distro) 2021-08-03T10:31:27.840 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q kernel --last | head -n 1 2021-08-03T10:31:27.966 INFO:teuthology.orchestra.run.smithi101.stdout:kernel-4.18.0-305.10.2.el8_4.x86_64 Tue 03 Aug 2021 10:31:02 AM UTC 2021-08-03T10:31:27.968 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:27.968 DEBUG:teuthology.orchestra.run.smithi101:> sudo rpm -qi grub2-tools 2021-08-03T10:31:27.998 INFO:teuthology.orchestra.run.smithi101.stdout:Name : grub2-tools 2021-08-03T10:31:27.999 INFO:teuthology.orchestra.run.smithi101.stdout:Epoch : 1 2021-08-03T10:31:27.999 INFO:teuthology.orchestra.run.smithi101.stdout:Version : 2.02 2021-08-03T10:31:27.999 INFO:teuthology.orchestra.run.smithi101.stdout:Release : 90.el8 2021-08-03T10:31:27.999 INFO:teuthology.orchestra.run.smithi101.stdout:Architecture: x86_64 2021-08-03T10:31:28.000 INFO:teuthology.orchestra.run.smithi101.stdout:Install Date: Mon 01 Mar 2021 06:17:56 PM UTC 2021-08-03T10:31:28.000 INFO:teuthology.orchestra.run.smithi101.stdout:Group : System Environment/Base 2021-08-03T10:31:28.000 INFO:teuthology.orchestra.run.smithi101.stdout:Size : 9197207 2021-08-03T10:31:28.000 INFO:teuthology.orchestra.run.smithi101.stdout:License : GPLv3+ 2021-08-03T10:31:28.001 INFO:teuthology.orchestra.run.smithi101.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-08-03T10:31:28.001 INFO:teuthology.orchestra.run.smithi101.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-08-03T10:31:28.001 INFO:teuthology.orchestra.run.smithi101.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-08-03T10:31:28.001 INFO:teuthology.orchestra.run.smithi101.stdout:Build Host : kbuilder.bsys.centos.org 2021-08-03T10:31:28.001 INFO:teuthology.orchestra.run.smithi101.stdout:Relocations : (not relocatable) 2021-08-03T10:31:28.002 INFO:teuthology.orchestra.run.smithi101.stdout:Packager : CentOS BuildSystem 2021-08-03T10:31:28.002 INFO:teuthology.orchestra.run.smithi101.stdout:Vendor : CentOS 2021-08-03T10:31:28.002 INFO:teuthology.orchestra.run.smithi101.stdout:URL : http://www.gnu.org/software/grub/ 2021-08-03T10:31:28.002 INFO:teuthology.orchestra.run.smithi101.stdout:Summary : Support tools for GRUB. 2021-08-03T10:31:28.003 INFO:teuthology.orchestra.run.smithi101.stdout:Description : 2021-08-03T10:31:28.003 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:31:28.003 INFO:teuthology.orchestra.run.smithi101.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-08-03T10:31:28.003 INFO:teuthology.orchestra.run.smithi101.stdout:customizable bootloader with modular architecture. It supports a rich 2021-08-03T10:31:28.003 INFO:teuthology.orchestra.run.smithi101.stdout:variety of kernel formats, file systems, computer architectures and 2021-08-03T10:31:28.004 INFO:teuthology.orchestra.run.smithi101.stdout:hardware devices. 2021-08-03T10:31:28.004 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:31:28.004 INFO:teuthology.orchestra.run.smithi101.stdout:This subpackage provides tools for support of all platforms. 2021-08-03T10:31:28.005 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-08-03T10:31:28.005 INFO:teuthology.task.kernel:Updating grub on smithi101 to boot 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:28.006 DEBUG:teuthology.orchestra.run.smithi101:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-08-03T10:31:29.715 INFO:teuthology.orchestra.run.smithi101.stderr:Generating grub configuration file ... 2021-08-03T10:31:31.688 INFO:teuthology.orchestra.run.smithi101.stderr:done 2021-08-03T10:31:31.689 DEBUG:teuthology.orchestra.run.smithi101:> mktemp 2021-08-03T10:31:31.738 INFO:teuthology.orchestra.run.smithi101.stdout:/tmp/tmp.qKX49iiwDA 2021-08-03T10:31:31.738 DEBUG:teuthology.orchestra.run.smithi101:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qKX49iiwDA 2021-08-03T10:31:31.779 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 0666 /tmp/tmp.qKX49iiwDA 2021-08-03T10:31:31.939 DEBUG:teuthology.orchestra.remote:smithi101:/tmp/tmp.qKX49iiwDA is 6KB 2021-08-03T10:31:31.987 DEBUG:teuthology.orchestra.run.smithi101:> rm -fr /tmp/tmp.qKX49iiwDA 2021-08-03T10:31:32.000 DEBUG:teuthology.orchestra.run.smithi101:> sudo /bin/ls /boot/loader/entries || true 2021-08-03T10:31:32.062 INFO:teuthology.orchestra.run.smithi101.stdout:631d84db90f7409fbdd390573ae89718-0-rescue.conf 2021-08-03T10:31:32.063 INFO:teuthology.orchestra.run.smithi101.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.10.1.el8_3.x86_64.conf 2021-08-03T10:31:32.063 INFO:teuthology.orchestra.run.smithi101.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-240.el8.x86_64.conf 2021-08-03T10:31:32.063 INFO:teuthology.orchestra.run.smithi101.stdout:631d84db90f7409fbdd390573ae89718-4.18.0-305.10.2.el8_4.x86_64.conf 2021-08-03T10:31:32.064 DEBUG:teuthology.orchestra.run.smithi101:> sudo grub2-set-default 631d84db90f7409fbdd390573ae89718-4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:31:32.218 DEBUG:teuthology.orchestra.run.smithi101:> sudo shutdown -r now 2021-08-03T10:32:02.252 INFO:teuthology.misc:Re-opening connections... 2021-08-03T10:32:02.253 INFO:teuthology.misc:trying to connect to ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:32:02.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-03T10:32:02.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:33:02.302 DEBUG:teuthology.orchestra.remote:timed out 2021-08-03T10:33:02.304 INFO:teuthology.misc:trying to connect to ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:33:02.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-03T10:33:02.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:33:05.387 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.101 2021-08-03T10:33:05.387 DEBUG:teuthology.misc:waited 63.1346321105957 2021-08-03T10:33:06.389 INFO:teuthology.misc:trying to connect to ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:33:06.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-03T10:33:06.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:33:07.020 DEBUG:teuthology.orchestra.run.smithi003:> true 2021-08-03T10:33:07.556 DEBUG:teuthology.misc:waited 65.3035192489624 2021-08-03T10:33:08.557 INFO:teuthology.misc:trying to connect to ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:33:08.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-03T10:33:08.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:33:08.818 DEBUG:teuthology.orchestra.run.smithi101:> true 2021-08-03T10:33:09.235 DEBUG:teuthology.misc:waited 66.98225498199463 2021-08-03T10:33:10.236 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-08-03T10:33:10.237 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-305.10.2.el8_4.x86_64"... 2021-08-03T10:33:10.237 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2021-08-03T10:33:10.256 INFO:teuthology.orchestra.run.smithi003.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:33:10.256 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.10.2.el8_4.x86_64 vs 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:33:10.256 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-08-03T10:33:10.257 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-08-03T10:33:10.257 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-08-03T10:33:10.257 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-305.10.2.el8_4.x86_64"... 2021-08-03T10:33:10.257 DEBUG:teuthology.orchestra.run.smithi101:> uname -r 2021-08-03T10:33:10.274 INFO:teuthology.orchestra.run.smithi101.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:33:10.275 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.10.2.el8_4.x86_64 vs 4.18.0-305.10.2.el8_4.x86_64 2021-08-03T10:33:10.275 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-08-03T10:33:10.275 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-08-03T10:33:11.277 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-08-03T10:33:11.277 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-08-03T10:33:11.352 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2021-08-03T10:33:11.371 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-08-03T10:33:11.371 DEBUG:teuthology.orchestra.run.smithi101:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-08-03T10:33:11.446 INFO:teuthology.orchestra.run.smithi101.stdout:ttyS1 2021-08-03T10:33:11.474 INFO:teuthology.run_tasks:Running task internal.base... 2021-08-03T10:33:11.485 INFO:teuthology.task.internal:Creating test directory... 2021-08-03T10:33:11.486 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-08-03T10:33:11.488 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-08-03T10:33:11.503 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-08-03T10:33:11.512 INFO:teuthology.run_tasks:Running task internal.archive... 2021-08-03T10:33:11.526 INFO:teuthology.task.internal:Creating archive directory... 2021-08-03T10:33:11.527 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-08-03T10:33:11.546 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-08-03T10:33:11.567 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-08-03T10:33:11.574 INFO:teuthology.task.internal:Enabling coredump saving... 2021-08-03T10:33:11.575 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-08-03T10:33:11.604 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-08-03T10:33:11.631 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-08-03T10:33:11.643 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-08-03T10:33:11.658 INFO:teuthology.orchestra.run.smithi101.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-08-03T10:33:11.668 INFO:teuthology.orchestra.run.smithi101.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-08-03T10:33:11.669 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-08-03T10:33:11.679 INFO:teuthology.task.internal:Configuring sudo... 2021-08-03T10:33:11.679 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-08-03T10:33:11.687 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-08-03T10:33:11.712 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-08-03T10:33:11.726 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-08-03T10:33:11.726 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-08-03T10:33:11.755 DEBUG:teuthology.orchestra.run.smithi101:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-08-03T10:33:11.770 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-08-03T10:33:11.846 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-08-03T10:33:11.902 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-08-03T10:33:11.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-08-03T10:33:12.024 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:33:12.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-08-03T10:33:12.089 DEBUG:teuthology.orchestra.run.smithi101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-08-03T10:33:12.122 DEBUG:teuthology.orchestra.run.smithi101:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-08-03T10:33:12.171 DEBUG:teuthology.orchestra.run.smithi101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-08-03T10:33:12.244 DEBUG:teuthology.orchestra.run.smithi101:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-08-03T10:33:12.290 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:33:12.291 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-08-03T10:33:12.363 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2021-08-03T10:33:12.366 DEBUG:teuthology.orchestra.run.smithi101:> sudo service rsyslog restart 2021-08-03T10:33:12.430 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-08-03T10:33:12.473 INFO:teuthology.orchestra.run.smithi101.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-08-03T10:33:12.859 INFO:teuthology.run_tasks:Running task internal.timer... 2021-08-03T10:33:12.870 INFO:teuthology.task.internal:Starting timer... 2021-08-03T10:33:12.870 INFO:teuthology.run_tasks:Running task pcp... 2021-08-03T10:33:12.896 INFO:teuthology.run_tasks:Running task selinux... 2021-08-03T10:33:12.910 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-08-03T10:33:12.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2021-08-03T10:33:12.979 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: [ OK ] 2021-08-03T10:33:12.980 DEBUG:teuthology.orchestra.run.smithi101:> sudo service auditd rotate 2021-08-03T10:33:13.057 INFO:teuthology.orchestra.run.smithi101.stdout:Rotating logs: [ OK ] 2021-08-03T10:33:13.058 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-08-03T10:33:13.059 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2021-08-03T10:33:13.084 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2021-08-03T10:33:13.084 DEBUG:teuthology.orchestra.run.smithi101:> /usr/sbin/getenforce 2021-08-03T10:33:13.104 INFO:teuthology.orchestra.run.smithi101.stdout:Permissive 2021-08-03T10:33:13.104 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi101.front.sepia.ceph.com': 'permissive'} 2021-08-03T10:33:13.105 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-08-03T10:33:13.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-08-03T10:33:13.151 DEBUG:teuthology.orchestra.run.smithi101:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-08-03T10:33:13.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-08-03T10:33:13.177 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-08-03T10:33:13.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2021-08-03T10:33:13.219 DEBUG:teuthology.orchestra.run.smithi101:> sudo /usr/sbin/setenforce permissive 2021-08-03T10:33:13.248 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-08-03T10:33:13.259 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-08-03T10:33:13.260 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-08-03T10:33:13.283 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-08-03T10:33:13.285 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi101.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-08-03T10:33:13.641 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-08-03T10:33:14.431 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-08-03T10:33:17.229 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-08-03T10:33:17.253 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:17 +0000 (0:00:00.040) 0:00:00.040 ******** 2021-08-03T10:33:17.268 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:17 +0000 (0:00:00.014) 0:00:00.055 ******** 2021-08-03T10:33:18.742 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi003.front.sepia.ceph.com] 2021-08-03T10:33:18.789 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:18 +0000 (0:00:01.521) 0:00:01.576 ******** 2021-08-03T10:33:19.230 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-08-03T10:33:19.232 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-08-03T10:33:19.251 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:19 +0000 (0:00:00.462) 0:00:02.039 ******** 2021-08-03T10:33:19.817 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-08-03T10:33:19.819 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-08-03T10:33:19.839 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:19 +0000 (0:00:00.587) 0:00:02.626 ******** 2021-08-03T10:33:19.879 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-08-03T10:33:19.881 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] 2021-08-03T10:33:20.014 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:20 +0000 (0:00:00.175) 0:00:02.802 ******** 2021-08-03T10:33:20.031 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:20.055 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:20 +0000 (0:00:00.040) 0:00:02.842 ******** 2021-08-03T10:33:20.196 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-08-03T10:33:20.198 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-08-03T10:33:20.218 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:20 +0000 (0:00:00.163) 0:00:03.005 ******** 2021-08-03T10:33:20.369 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-08-03T10:33:20.371 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:33:20.391 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:20 +0000 (0:00:00.173) 0:00:03.179 ******** 2021-08-03T10:33:20.490 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-08-03T10:33:20.492 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-08-03T10:33:20.513 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:20 +0000 (0:00:00.122) 0:00:03.301 ******** 2021-08-03T10:33:20.582 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-08-03T10:33:20.583 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:20.603 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:20 +0000 (0:00:00.089) 0:00:03.390 ******** 2021-08-03T10:33:20.785 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-08-03T10:33:20.787 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:33:20.806 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:20 +0000 (0:00:00.203) 0:00:03.594 ******** 2021-08-03T10:33:21.399 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-08-03T10:33:21.401 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627986800.4333782-4062-80434766873254/source", "state": "file", "uid": 0} 2021-08-03T10:33:21.421 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:21 +0000 (0:00:00.615) 0:00:04.209 ******** 2021-08-03T10:33:21.428 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627986800.849609-4097-65633471272557/source", "state": "file", "uid": 0} 2021-08-03T10:33:21.451 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:21 +0000 (0:00:00.030) 0:00:04.239 ******** 2021-08-03T10:33:21.850 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-08-03T10:33:21.852 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-08-03T10:33:21.854 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-08-03T10:33:21.872 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-08-03T10:33:21.873 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-08-03T10:33:21.945 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-08-03T10:33:21.947 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-08-03T10:33:21.959 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-08-03T10:33:21.961 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:21 +0000 (0:00:00.507) 0:00:04.747 ******** 2021-08-03T10:33:22.493 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] 2021-08-03T10:33:22.502 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] 2021-08-03T10:33:22.518 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-08-03T10:33:22.520 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:22 +0000 (0:00:00.559) 0:00:05.306 ******** 2021-08-03T10:33:22.550 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-08-03T10:33:22.561 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-08-03T10:33:22.566 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-08-03T10:33:22.716 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:22 +0000 (0:00:00.197) 0:00:05.504 ******** 2021-08-03T10:33:22.736 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:22 +0000 (0:00:00.019) 0:00:05.524 ******** 2021-08-03T10:33:23.357 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi003.front.sepia.ceph.com] 2021-08-03T10:33:23.366 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] 2021-08-03T10:33:23.427 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-08-03T10:33:23.429 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:23 +0000 (0:00:00.691) 0:00:06.215 ******** 2021-08-03T10:33:23.450 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:23 +0000 (0:00:00.023) 0:00:06.238 ******** 2021-08-03T10:33:23.935 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-08-03T10:33:23.937 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.170955", "end": "2021-08-03 10:33:23.911981", "rc": 0, "start": "2021-08-03 10:33:23.741026", "stderr": "", "stderr_lines": [], "stdout": "fb244dd758144cf455d1a3240c7f765bdfc7340a", "stdout_lines": ["fb244dd758144cf455d1a3240c7f765bdfc7340a"]} 2021-08-03T10:33:23.958 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:23 +0000 (0:00:00.507) 0:00:06.745 ******** 2021-08-03T10:33:23.965 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.193474", "end": "2021-08-03 10:33:23.934260", "rc": 0, "start": "2021-08-03 10:33:23.740786", "stderr": "", "stderr_lines": [], "stdout": "fb244dd758144cf455d1a3240c7f765bdfc7340a", "stdout_lines": ["fb244dd758144cf455d1a3240c7f765bdfc7340a"]} 2021-08-03T10:33:23.988 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:23 +0000 (0:00:00.030) 0:00:06.776 ******** 2021-08-03T10:33:24.159 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-08-03T10:33:24.161 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013657", "end": "2021-08-03 10:33:24.141028", "failed_when_result": false, "rc": 0, "start": "2021-08-03 10:33:24.127371", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-08-03T10:33:24.181 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.192) 0:00:06.969 ******** 2021-08-03T10:33:24.188 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007901", "end": "2021-08-03 10:33:24.157959", "failed_when_result": false, "rc": 0, "start": "2021-08-03 10:33:24.150058", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-08-03T10:33:24.211 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.030) 0:00:06.999 ******** 2021-08-03T10:33:24.249 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-08-03T10:33:24.251 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.272 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.060) 0:00:07.059 ******** 2021-08-03T10:33:24.278 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.302 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.030) 0:00:07.090 ******** 2021-08-03T10:33:24.340 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-08-03T10:33:24.341 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.362 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.060) 0:00:07.150 ******** 2021-08-03T10:33:24.379 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.402 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.039) 0:00:07.189 ******** 2021-08-03T10:33:24.430 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-08-03T10:33:24.432 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.453 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.051) 0:00:07.241 ******** 2021-08-03T10:33:24.481 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.503 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.049) 0:00:07.291 ******** 2021-08-03T10:33:24.520 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-08-03T10:33:24.522 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.544 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.040) 0:00:07.331 ******** 2021-08-03T10:33:24.592 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.618 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.074) 0:00:07.406 ******** 2021-08-03T10:33:24.625 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-08-03T10:33:24.626 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.649 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.030) 0:00:07.436 ******** 2021-08-03T10:33:24.687 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:33:24.712 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.063) 0:00:07.500 ******** 2021-08-03T10:33:24.885 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-08-03T10:33:24.887 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:33:24.909 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.196) 0:00:07.696 ******** 2021-08-03T10:33:24.937 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:33:24.960 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:33:24 +0000 (0:00:00.051) 0:00:07.748 ******** 2021-08-03T10:33:25.195 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-08-03T10:33:25.196 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-08-03T10:33:25.238 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-08-03T10:33:25.394 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-08-03T10:33:25.437 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-08-03T10:33:25.596 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-08-03T10:33:25.628 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-08-03T10:33:25.796 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-08-03T10:33:25.828 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-08-03T10:33:25.996 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-08-03T10:33:26.017 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-08-03T10:33:26.194 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-08-03T10:33:26.205 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-08-03T10:33:26.405 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-08-03T10:33:26.407 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-08-03T10:33:26.595 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-08-03T10:33:26.597 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-08-03T10:33:26.783 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-08-03T10:33:26.805 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-08-03T10:33:26.982 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-08-03T10:33:27.003 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-08-03T10:33:27.170 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-08-03T10:33:27.202 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-08-03T10:33:27.369 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-08-03T10:33:27.412 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-08-03T10:33:27.558 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-08-03T10:33:27.611 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-08-03T10:33:27.747 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-08-03T10:33:27.812 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-08-03T10:33:27.939 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-08-03T10:33:28.023 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-08-03T10:33:28.138 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-08-03T10:33:28.222 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-08-03T10:33:28.327 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-08-03T10:33:28.422 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-08-03T10:33:28.526 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-08-03T10:33:28.620 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-08-03T10:33:28.715 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-08-03T10:33:28.821 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-08-03T10:33:28.916 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-08-03T10:33:29.031 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-08-03T10:33:29.106 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-08-03T10:33:29.231 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-08-03T10:33:29.294 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-08-03T10:33:29.430 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-08-03T10:33:29.494 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-08-03T10:33:29.640 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-08-03T10:33:29.703 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-08-03T10:33:29.860 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-08-03T10:33:29.891 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-08-03T10:33:30.058 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-08-03T10:33:30.091 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-08-03T10:33:30.259 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-08-03T10:33:30.281 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-08-03T10:33:30.468 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-08-03T10:33:30.470 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-08-03T10:33:30.659 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-08-03T10:33:30.671 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-08-03T10:33:30.869 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-08-03T10:33:30.880 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-08-03T10:33:31.057 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-08-03T10:33:31.079 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-08-03T10:33:31.257 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-08-03T10:33:31.279 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-08-03T10:33:31.445 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-08-03T10:33:31.478 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-08-03T10:33:31.634 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-08-03T10:33:31.686 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-08-03T10:33:31.833 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-08-03T10:33:31.887 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-08-03T10:33:32.033 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-08-03T10:33:32.086 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-08-03T10:33:32.223 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-08-03T10:33:32.286 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-08-03T10:33:32.412 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-08-03T10:33:32.497 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-08-03T10:33:32.611 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-08-03T10:33:32.695 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-08-03T10:33:32.799 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-08-03T10:33:32.893 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-08-03T10:33:32.998 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-08-03T10:33:33.103 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-08-03T10:33:33.186 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-08-03T10:33:33.302 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-08-03T10:33:33.385 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-08-03T10:33:33.501 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-08-03T10:33:33.574 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-08-03T10:33:33.700 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-08-03T10:33:33.774 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-08-03T10:33:33.901 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-08-03T10:33:33.964 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-08-03T10:33:34.111 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-08-03T10:33:34.153 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-08-03T10:33:34.309 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-08-03T10:33:34.351 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-08-03T10:33:34.508 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-08-03T10:33:34.550 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-08-03T10:33:34.717 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-08-03T10:33:34.738 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-08-03T10:33:34.915 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-08-03T10:33:34.938 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-08-03T10:33:35.114 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-08-03T10:33:35.126 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-08-03T10:33:35.313 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-08-03T10:33:35.324 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-08-03T10:33:35.511 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-08-03T10:33:35.512 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-08-03T10:33:35.709 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-08-03T10:33:35.721 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-08-03T10:33:35.897 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-08-03T10:33:35.919 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-08-03T10:33:36.085 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-08-03T10:33:36.118 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-08-03T10:33:36.284 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-08-03T10:33:36.315 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-08-03T10:33:36.473 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-08-03T10:33:36.516 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-08-03T10:33:36.662 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-08-03T10:33:36.725 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-08-03T10:33:36.860 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-08-03T10:33:36.924 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-08-03T10:33:37.059 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-08-03T10:33:37.122 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-08-03T10:33:37.247 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-08-03T10:33:37.320 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-08-03T10:33:37.446 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-08-03T10:33:37.529 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-08-03T10:33:37.634 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-08-03T10:33:37.728 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-08-03T10:33:37.833 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-08-03T10:33:37.927 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-08-03T10:33:38.023 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-08-03T10:33:38.137 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-08-03T10:33:38.210 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-08-03T10:33:38.336 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-08-03T10:33:38.410 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-08-03T10:33:38.534 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-08-03T10:33:38.598 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-08-03T10:33:38.735 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-08-03T10:33:38.788 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-08-03T10:33:38.945 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-08-03T10:33:38.988 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-08-03T10:33:39.144 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-08-03T10:33:39.176 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-08-03T10:33:39.343 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-08-03T10:33:39.365 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-08-03T10:33:39.552 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-08-03T10:33:39.563 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-08-03T10:33:39.752 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-08-03T10:33:39.754 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-08-03T10:33:39.942 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-08-03T10:33:39.954 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-08-03T10:33:40.141 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-08-03T10:33:40.153 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-08-03T10:33:40.329 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-08-03T10:33:40.350 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-08-03T10:33:40.518 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-08-03T10:33:40.550 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-08-03T10:33:40.718 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-08-03T10:33:40.751 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-08-03T10:33:40.906 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-08-03T10:33:40.960 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-08-03T10:33:41.105 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-08-03T10:33:41.158 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-08-03T10:33:41.293 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-08-03T10:33:41.367 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-08-03T10:33:41.482 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-08-03T10:33:41.566 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-08-03T10:33:41.681 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-08-03T10:33:41.775 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-08-03T10:33:41.869 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-08-03T10:33:41.976 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-08-03T10:33:42.070 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-08-03T10:33:42.174 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-08-03T10:33:42.257 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-08-03T10:33:42.373 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-08-03T10:33:42.447 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-08-03T10:33:42.572 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-08-03T10:33:42.646 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-08-03T10:33:42.781 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-08-03T10:33:42.833 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-08-03T10:33:42.979 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-08-03T10:33:43.032 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-08-03T10:33:43.177 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-08-03T10:33:43.230 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-08-03T10:33:43.386 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-08-03T10:33:43.420 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-08-03T10:33:43.586 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-08-03T10:33:43.618 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-08-03T10:33:43.785 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-08-03T10:33:43.807 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-08-03T10:33:43.994 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-08-03T10:33:44.006 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-08-03T10:33:44.193 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-08-03T10:33:44.194 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-08-03T10:33:44.391 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-08-03T10:33:44.392 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-08-03T10:33:44.579 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-08-03T10:33:44.601 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-08-03T10:33:44.778 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-08-03T10:33:44.800 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-08-03T10:33:44.966 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-08-03T10:33:44.998 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-08-03T10:33:45.155 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-08-03T10:33:45.198 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-08-03T10:33:45.355 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-08-03T10:33:45.398 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-08-03T10:33:45.545 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-08-03T10:33:45.598 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-08-03T10:33:45.733 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-08-03T10:33:45.807 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-08-03T10:33:45.934 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-08-03T10:33:46.007 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-08-03T10:33:46.132 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-08-03T10:33:46.206 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-08-03T10:33:46.321 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-08-03T10:33:46.406 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-08-03T10:33:46.510 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-08-03T10:33:46.616 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-08-03T10:33:46.711 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-08-03T10:33:46.816 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-08-03T10:33:46.900 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-08-03T10:33:47.015 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-08-03T10:33:47.100 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-08-03T10:33:47.225 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-08-03T10:33:47.289 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-08-03T10:33:47.424 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-08-03T10:33:47.487 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-08-03T10:33:47.623 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-08-03T10:33:47.678 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-08-03T10:33:47.825 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-08-03T10:33:47.878 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-08-03T10:33:48.025 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-08-03T10:33:48.067 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-08-03T10:33:48.234 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-08-03T10:33:48.266 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-08-03T10:33:48.444 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-08-03T10:33:48.455 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-08-03T10:33:48.643 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-08-03T10:33:48.644 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-08-03T10:33:48.842 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-08-03T10:33:48.844 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-08-03T10:33:49.033 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-08-03T10:33:49.045 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-08-03T10:33:49.222 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-08-03T10:33:49.254 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-08-03T10:33:49.422 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-08-03T10:33:49.454 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-08-03T10:33:49.611 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-08-03T10:33:49.654 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-08-03T10:33:49.812 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-08-03T10:33:49.865 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-08-03T10:33:50.002 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-08-03T10:33:50.076 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-08-03T10:33:50.192 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-08-03T10:33:50.276 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-08-03T10:33:50.391 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-08-03T10:33:50.475 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-08-03T10:33:50.591 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-08-03T10:33:50.676 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-08-03T10:33:50.781 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-08-03T10:33:50.874 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-08-03T10:33:50.969 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-08-03T10:33:51.084 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-08-03T10:33:51.168 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-08-03T10:33:51.284 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-08-03T10:33:51.368 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-08-03T10:33:51.482 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-08-03T10:33:51.556 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-08-03T10:33:51.693 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-08-03T10:33:51.757 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-08-03T10:33:51.894 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-08-03T10:33:52.104 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-08-03T10:33:52.302 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-08-03T10:33:52.500 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-08-03T10:33:52.708 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-08-03T10:33:52.906 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-08-03T10:33:53.407 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-08-03T10:33:54.663 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-08-03T10:33:55.317 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-08-03T10:33:56.479 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-08-03T10:33:56.874 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-08-03T10:33:58.126 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-08-03T10:33:58.357 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-08-03T10:33:59.774 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-08-03T10:33:59.868 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-08-03T10:34:01.423 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-08-03T10:34:01.434 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-08-03T10:34:02.932 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-08-03T10:34:03.005 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-08-03T10:34:04.424 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-08-03T10:34:04.684 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-08-03T10:34:05.964 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-08-03T10:34:06.369 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-08-03T10:34:07.537 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-08-03T10:34:07.970 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-08-03T10:34:09.118 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-08-03T10:34:09.678 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-08-03T10:34:10.741 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-08-03T10:34:11.456 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-08-03T10:34:12.377 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-08-03T10:34:13.131 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-08-03T10:34:13.959 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-08-03T10:34:14.812 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-08-03T10:34:15.577 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-08-03T10:34:15.700 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:15 +0000 (0:00:50.739) 0:00:58.487 ******** 2021-08-03T10:34:15.768 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-08-03T10:34:15.788 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:15 +0000 (0:00:00.088) 0:00:58.576 ******** 2021-08-03T10:34:15.869 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-08-03T10:34:15.871 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-08-03T10:34:15.873 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-08-03T10:34:15.874 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-08-03T10:34:15.876 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-08-03T10:34:15.877 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99 2021-08-03T10:34:15.878 INFO:teuthology.task.ansible.out:bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-08-03T10:34:15.880 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-08-03T10:34:15.882 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-08-03T10:34:15.883 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-08-03T10:34:15.885 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-08-03T10:34:15.886 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf75 2021-08-03T10:34:15.887 INFO:teuthology.task.ansible.out:6f2b8313645d2b8da3"}, {"nam 2021-08-03T10:34:15.888 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-08-03T10:34:15.890 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-08-03T10:34:15.892 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-08-03T10:34:15.893 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-08-03T10:34:15.913 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:15 +0000 (0:00:00.124) 0:00:58.701 ******** 2021-08-03T10:34:16.644 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-08-03T10:34:16.646 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-08-03T10:34:16.864 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-08-03T10:34:16.867 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"after": "fb244dd758144cf455d1a3240c7f765bdfc7340a", "attempts": 1, "before": "fb244dd758144cf455d1a3240c7f765bdfc7340a", "changed": false, "remote_url_changed": false} 2021-08-03T10:34:16.888 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:16 +0000 (0:00:00.974) 0:00:59.675 ******** 2021-08-03T10:34:17.208 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:17.210 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-08-03T10:34:17.416 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-08-03T10:34:17.635 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-08-03T10:34:17.842 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-08-03T10:34:17.844 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-08-03T10:34:18.041 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-08-03T10:34:18.249 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-08-03T10:34:18.251 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-08-03T10:34:18.363 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-08-03T10:34:18.365 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-08-03T10:34:18.460 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:18.461 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-08-03T10:34:18.481 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:18 +0000 (0:00:01.592) 0:01:01.268 ******** 2021-08-03T10:34:18.545 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-08-03T10:34:18.566 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:18 +0000 (0:00:00.085) 0:01:01.354 ******** 2021-08-03T10:34:18.646 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-08-03T10:34:18.648 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-08-03T10:34:18.649 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-08-03T10:34:18.651 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-08-03T10:34:18.653 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\ 2021-08-03T10:34:18.653 INFO:teuthology.task.ansible.out:nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-08-03T10:34:18.655 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-08-03T10:34:18.656 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-08-03T10:34:18.658 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-08-03T10:34:18.660 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-08-03T10:34:18.661 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc99 2021-08-03T10:34:18.662 INFO:teuthology.task.ansible.out:3327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-08-03T10:34:18.663 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-08-03T10:34:18.665 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-08-03T10:34:18.666 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-08-03T10:34:18.668 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-08-03T10:34:18.670 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAAD 2021-08-03T10:34:18.671 INFO:teuthology.task.ansible.out:AQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-08-03T10:34:18.688 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:18 +0000 (0:00:00.121) 0:01:01.475 ******** 2021-08-03T10:34:18.869 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-08-03T10:34:18.881 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:19.079 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-08-03T10:34:19.081 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-08-03T10:34:19.286 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-08-03T10:34:19.288 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:19.298 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:19.340 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-08-03T10:34:19.342 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"after": "fb244dd758144cf455d1a3240c7f765bdfc7340a", "attempts": 1, "before": "fb244dd758144cf455d1a3240c7f765bdfc7340a", "changed": false, "remote_url_changed": false} 2021-08-03T10:34:19.362 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:19 +0000 (0:00:00.674) 0:01:02.150 ******** 2021-08-03T10:34:19.502 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:19.504 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-08-03T10:34:19.700 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-08-03T10:34:19.711 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-08-03T10:34:19.713 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-08-03T10:34:19.919 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-08-03T10:34:19.921 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-08-03T10:34:20.129 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-08-03T10:34:20.131 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-08-03T10:34:20.140 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-08-03T10:34:20.326 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-08-03T10:34:20.358 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-08-03T10:34:20.360 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-08-03T10:34:20.524 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-08-03T10:34:20.567 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-08-03T10:34:20.744 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-08-03T10:34:20.786 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-08-03T10:34:20.788 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-08-03T10:34:20.943 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-08-03T10:34:20.945 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-08-03T10:34:20.996 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-08-03T10:34:21.141 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-08-03T10:34:21.143 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-08-03T10:34:21.215 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-08-03T10:34:21.349 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-08-03T10:34:21.422 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-08-03T10:34:21.433 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:21.569 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-08-03T10:34:21.644 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-08-03T10:34:21.646 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-08-03T10:34:21.780 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-08-03T10:34:21.783 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-08-03T10:34:21.854 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-08-03T10:34:21.855 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-08-03T10:34:21.865 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:21.876 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:21.980 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-08-03T10:34:22.085 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-08-03T10:34:22.180 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-08-03T10:34:22.300 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-08-03T10:34:22.302 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-08-03T10:34:22.394 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-08-03T10:34:22.509 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-08-03T10:34:22.592 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-08-03T10:34:22.717 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-08-03T10:34:22.718 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-08-03T10:34:22.801 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-08-03T10:34:22.937 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-08-03T10:34:22.999 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-08-03T10:34:23.001 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-08-03T10:34:23.156 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-08-03T10:34:23.197 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-08-03T10:34:23.364 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-08-03T10:34:23.417 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-08-03T10:34:23.585 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-08-03T10:34:23.587 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-08-03T10:34:23.616 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-08-03T10:34:23.794 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-08-03T10:34:23.796 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-08-03T10:34:23.816 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-08-03T10:34:24.013 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-08-03T10:34:24.015 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-08-03T10:34:24.223 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-08-03T10:34:24.225 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-08-03T10:34:24.433 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-08-03T10:34:24.455 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-08-03T10:34:24.457 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-08-03T10:34:24.645 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-08-03T10:34:24.656 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-08-03T10:34:24.843 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-08-03T10:34:24.845 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-08-03T10:34:24.875 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-08-03T10:34:25.057 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-08-03T10:34:25.059 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-08-03T10:34:25.089 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-08-03T10:34:25.255 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-08-03T10:34:25.297 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-08-03T10:34:25.463 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-08-03T10:34:25.505 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-08-03T10:34:25.664 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-08-03T10:34:25.717 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-08-03T10:34:25.719 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-08-03T10:34:25.873 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-08-03T10:34:25.875 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-08-03T10:34:25.937 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-08-03T10:34:26.082 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-08-03T10:34:26.084 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-08-03T10:34:26.086 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-08-03T10:34:26.145 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-08-03T10:34:26.281 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-08-03T10:34:26.354 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-08-03T10:34:26.489 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-08-03T10:34:26.573 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-08-03T10:34:26.689 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-08-03T10:34:26.782 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-08-03T10:34:26.887 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-08-03T10:34:26.993 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-08-03T10:34:27.085 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-08-03T10:34:27.200 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-08-03T10:34:27.295 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-08-03T10:34:27.297 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-08-03T10:34:27.421 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-08-03T10:34:27.493 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-08-03T10:34:27.629 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-08-03T10:34:27.631 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-08-03T10:34:27.691 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-08-03T10:34:27.858 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-08-03T10:34:27.860 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-08-03T10:34:27.900 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-08-03T10:34:27.902 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-08-03T10:34:28.066 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-08-03T10:34:28.108 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-08-03T10:34:28.286 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-08-03T10:34:28.308 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-08-03T10:34:28.505 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-08-03T10:34:28.516 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-08-03T10:34:28.518 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-08-03T10:34:28.714 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-08-03T10:34:28.716 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-08-03T10:34:28.922 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-08-03T10:34:28.934 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-08-03T10:34:28.935 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-08-03T10:34:28.937 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-08-03T10:34:29.120 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-08-03T10:34:29.153 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-08-03T10:34:29.319 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-08-03T10:34:29.361 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-08-03T10:34:29.517 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-08-03T10:34:29.570 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-08-03T10:34:29.726 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-08-03T10:34:29.790 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-08-03T10:34:29.925 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-08-03T10:34:30.009 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-08-03T10:34:30.134 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-08-03T10:34:30.228 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-08-03T10:34:30.230 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-08-03T10:34:30.343 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-08-03T10:34:30.436 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-08-03T10:34:30.541 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-08-03T10:34:30.645 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-08-03T10:34:30.739 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-08-03T10:34:30.864 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-08-03T10:34:30.866 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-08-03T10:34:30.948 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-08-03T10:34:31.094 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-08-03T10:34:31.147 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-08-03T10:34:31.304 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-08-03T10:34:31.356 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-08-03T10:34:31.523 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-08-03T10:34:31.525 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-08-03T10:34:31.555 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-08-03T10:34:31.732 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-08-03T10:34:31.764 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-08-03T10:34:31.952 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-08-03T10:34:31.964 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-08-03T10:34:32.173 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-08-03T10:34:32.174 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-08-03T10:34:32.372 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-08-03T10:34:32.383 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-08-03T10:34:32.581 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-08-03T10:34:32.602 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-08-03T10:34:32.778 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-08-03T10:34:32.780 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-08-03T10:34:32.810 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-08-03T10:34:32.987 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-08-03T10:34:33.020 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-08-03T10:34:33.186 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-08-03T10:34:33.240 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-08-03T10:34:33.395 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-08-03T10:34:33.448 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-08-03T10:34:33.594 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-08-03T10:34:33.667 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-08-03T10:34:33.803 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-08-03T10:34:33.804 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-08-03T10:34:33.877 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-08-03T10:34:34.022 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-08-03T10:34:34.024 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-08-03T10:34:34.096 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-08-03T10:34:34.221 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-08-03T10:34:34.305 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-08-03T10:34:34.421 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-08-03T10:34:34.516 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-08-03T10:34:34.622 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-08-03T10:34:34.833 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-08-03T10:34:34.885 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-08-03T10:34:35.031 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-08-03T10:34:35.094 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-08-03T10:34:35.239 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-08-03T10:34:35.302 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-08-03T10:34:35.448 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-08-03T10:34:35.521 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-08-03T10:34:35.647 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-08-03T10:34:35.648 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-08-03T10:34:35.730 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-08-03T10:34:35.855 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-08-03T10:34:35.952 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-08-03T10:34:36.057 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-08-03T10:34:36.161 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-08-03T10:34:36.162 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-08-03T10:34:36.266 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-08-03T10:34:36.371 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-08-03T10:34:36.464 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-08-03T10:34:36.580 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-08-03T10:34:36.674 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-08-03T10:34:36.810 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-08-03T10:34:36.873 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-08-03T10:34:37.019 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-08-03T10:34:37.072 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-08-03T10:34:37.074 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-08-03T10:34:37.238 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-08-03T10:34:37.240 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-08-03T10:34:37.280 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-08-03T10:34:37.447 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-08-03T10:34:37.449 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-08-03T10:34:37.489 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-08-03T10:34:37.658 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-08-03T10:34:37.691 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-08-03T10:34:37.879 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-08-03T10:34:37.890 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-08-03T10:34:38.087 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-08-03T10:34:38.100 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-08-03T10:34:38.296 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-08-03T10:34:38.298 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-08-03T10:34:38.505 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-08-03T10:34:38.516 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-08-03T10:34:38.704 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-08-03T10:34:38.725 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-08-03T10:34:38.914 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-08-03T10:34:38.935 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-08-03T10:34:39.112 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-08-03T10:34:39.154 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-08-03T10:34:39.156 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-08-03T10:34:39.321 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-08-03T10:34:39.364 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-08-03T10:34:39.520 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-08-03T10:34:39.573 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-08-03T10:34:39.729 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-08-03T10:34:39.792 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-08-03T10:34:39.928 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-08-03T10:34:40.001 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-08-03T10:34:40.136 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-08-03T10:34:40.210 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-08-03T10:34:40.335 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-08-03T10:34:40.431 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-08-03T10:34:40.544 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-08-03T10:34:40.638 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-08-03T10:34:40.640 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-08-03T10:34:40.753 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-08-03T10:34:40.847 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-08-03T10:34:40.952 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-08-03T10:34:40.954 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-08-03T10:34:41.066 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-08-03T10:34:41.160 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-08-03T10:34:41.276 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-08-03T10:34:41.370 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-08-03T10:34:41.484 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-08-03T10:34:41.578 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-08-03T10:34:41.703 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-08-03T10:34:41.776 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-08-03T10:34:41.912 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-08-03T10:34:41.985 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-08-03T10:34:42.120 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-08-03T10:34:42.183 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-08-03T10:34:42.341 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-08-03T10:34:42.383 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-08-03T10:34:42.549 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-08-03T10:34:42.592 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-08-03T10:34:42.759 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-08-03T10:34:42.801 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-08-03T10:34:42.978 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-08-03T10:34:42.999 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-08-03T10:34:43.189 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-08-03T10:34:43.209 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-08-03T10:34:43.408 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-08-03T10:34:43.429 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-08-03T10:34:43.606 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-08-03T10:34:43.638 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-08-03T10:34:43.814 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-08-03T10:34:43.856 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-08-03T10:34:44.013 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-08-03T10:34:44.066 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-08-03T10:34:44.222 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-08-03T10:34:44.275 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-08-03T10:34:44.430 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-08-03T10:34:44.432 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-08-03T10:34:44.483 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-08-03T10:34:44.639 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-08-03T10:34:44.702 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-08-03T10:34:44.704 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-08-03T10:34:44.838 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-08-03T10:34:44.911 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-08-03T10:34:45.046 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-08-03T10:34:45.119 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-08-03T10:34:45.257 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-08-03T10:34:45.340 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-08-03T10:34:45.455 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-08-03T10:34:45.551 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-08-03T10:34:45.667 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-08-03T10:34:45.762 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-08-03T10:34:45.876 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-08-03T10:34:45.981 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-08-03T10:34:46.075 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-08-03T10:34:46.192 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-08-03T10:34:46.275 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-08-03T10:34:46.400 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-08-03T10:34:46.483 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-08-03T10:34:46.618 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-08-03T10:34:46.682 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-08-03T10:34:46.827 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-08-03T10:34:46.890 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-08-03T10:34:47.036 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-08-03T10:34:47.099 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-08-03T10:34:47.254 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-08-03T10:34:47.297 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-08-03T10:34:47.473 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-08-03T10:34:47.506 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-08-03T10:34:47.684 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-08-03T10:34:47.716 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-08-03T10:34:47.801 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:47 +0000 (0:00:28.439) 0:01:30.589 ******** 2021-08-03T10:34:47.891 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-08-03T10:34:48.038 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.040 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.050 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.061 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.062 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.072 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.073 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.083 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.085 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.105 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:48.107 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-08-03T10:34:48.303 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-08-03T10:34:48.306 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-08-03T10:34:48.308 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.315 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.318 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHsl 2021-08-03T10:34:48.320 INFO:teuthology.task.ansible.out:OKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-08-03T10:34:48.518 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-08-03T10:34:48.520 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-08-03T10:34:48.530 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-08-03T10:34:48.717 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-08-03T10:34:48.719 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfad 2021-08-03T10:34:48.721 INFO:teuthology.task.ansible.out:a28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.729 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.741 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.742 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.752 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:48.754 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c269 2021-08-03T10:34:48.756 INFO:teuthology.task.ansible.out:3e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.765 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.775 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.777 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.787 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.789 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.798 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.809 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.810 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.820 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.822 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.831 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.833 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.843 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.854 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.855 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.865 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.866 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.876 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.887 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.889 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.899 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.900 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.910 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.912 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.922 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.923 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.933 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.944 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.945 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.955 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.957 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.967 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.969 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.979 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.990 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:48.991 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.001 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.002 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.012 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.014 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.024 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.025 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.035 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.046 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.048 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.057 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.059 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.068 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.070 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.080 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.080 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.091 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.102 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.104 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.113 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.115 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.125 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.136 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.138 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.147 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.149 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.158 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.160 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.170 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.172 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.183 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.184 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.194 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.205 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.207 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.216 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.218 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.228 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.229 INFO:teuthology.task.ansible.out: skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.240 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.252 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.253 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.264 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.265 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.275 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.277 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.287 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.288 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.298 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.300 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.309 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.320 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.322 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.331 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.333 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.343 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.346 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.354 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.356 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.365 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.367 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.377 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.379 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.388 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:49.390 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a7 2021-08-03T10:34:49.391 INFO:teuthology.task.ansible.out:1908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.401 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.411 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.413 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.423 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.576 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var 2021-08-03T10:34:49.578 INFO:teuthology.task.ansible.out:": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia. 2021-08-03T10:34:49.579 INFO:teuthology.task.ansible.out:ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'dachary', 'ov 2021-08-03T10:34:49.581 INFO:teuthology.task.ansible.out:pn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehg 2021-08-03T10:34:49.583 INFO:teuthology.task.ansible.out:yfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f64185 2021-08-03T10:34:49.584 INFO:teuthology.task.ansible.out:2101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.592 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.594 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.603 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.614 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.734 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:49.736 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-08-03T10:34:49.755 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:49 +0000 (0:00:01.954) 0:01:32.543 ******** 2021-08-03T10:34:49.827 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-08-03T10:34:49.829 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:49.849 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:49 +0000 (0:00:00.093) 0:01:32.637 ******** 2021-08-03T10:34:49.877 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:49.878 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-08-03T10:34:50.086 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-08-03T10:34:50.119 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:50.121 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-08-03T10:34:50.296 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:50.298 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-08-03T10:34:50.308 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:50.310 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-08-03T10:34:50.510 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-08-03T10:34:50.512 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-08-03T10:34:50.704 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:50.706 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-08-03T10:34:50.726 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:50.728 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-08-03T10:34:50.893 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:50.895 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-08-03T10:34:50.946 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:50.948 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-08-03T10:34:51.082 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:51.084 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-08-03T10:34:51.156 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:51.158 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-08-03T10:34:51.271 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:51.273 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-08-03T10:34:51.376 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:51.377 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-08-03T10:34:51.459 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:51.461 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-08-03T10:34:51.585 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:51.587 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-08-03T10:34:51.648 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:51.650 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-08-03T10:34:51.805 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-03T10:34:51.807 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-08-03T10:34:51.880 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:51.882 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-08-03T10:34:51.902 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:51 +0000 (0:00:02.052) 0:01:34.690 ******** 2021-08-03T10:34:51.985 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-08-03T10:34:51.987 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:51.997 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.008 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.010 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.020 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.031 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.033 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi101.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.220 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:52.221 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-08-03T10:34:52.252 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-08-03T10:34:52.254 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-08-03T10:34:52.255 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.264 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.420 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:52.421 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-08-03T10:34:52.474 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-08-03T10:34:52.476 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-08-03T10:34:52.612 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:52.613 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-08-03T10:34:52.686 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi003.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-08-03T10:34:52.697 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.708 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.710 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.720 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.721 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.731 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.742 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.744 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.753 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.755 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.765 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.766 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.776 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.787 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.789 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.798 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.800 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi101.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.811 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.822 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.833 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.834 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.844 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.846 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.855 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.857 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.866 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.877 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.879 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.888 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.890 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.900 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.901 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.911 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.922 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.924 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.933 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.935 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.945 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.946 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.956 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.958 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.967 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.978 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.980 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:52.989 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:52.991 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.001 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.003 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.013 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.015 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.024 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.035 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.037 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.047 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.048 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.058 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.060 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.069 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.071 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.081 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.091 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.093 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.103 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.104 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.114 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.116 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.125 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.126 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.137 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.148 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.149 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.159 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.161 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.171 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.173 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi101.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-08-03T10:34:53.183 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-08-03T10:34:53.184 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.194 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.196 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.206 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.207 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.217 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.219 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.228 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.239 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.241 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.250 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.252 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.262 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.264 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.274 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.275 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.285 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.296 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.297 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.307 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.309 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.319 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.330 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.341 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.342 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.352 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.354 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.363 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.365 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi101.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.376 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.378 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.387 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.389 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.398 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.400 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.410 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.421 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.422 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.432 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.434 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.443 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.445 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.455 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.456 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.466 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.477 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.479 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.488 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.490 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.500 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.500 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.511 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.513 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.523 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.523 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.534 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.545 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.547 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.556 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:53.558 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.559 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.569 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.580 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.621 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:53 +0000 (0:00:01.718) 0:01:36.408 ******** 2021-08-03T10:34:53.689 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-08-03T10:34:53.691 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:34:53.711 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:34:53 +0000 (0:00:00.090) 0:01:36.498 ******** 2021-08-03T10:34:53.749 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:34:53.751 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-08-03T10:34:53.937 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-08-03T10:34:53.991 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-08-03T10:34:54.116 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-08-03T10:34:54.190 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-08-03T10:34:54.315 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-08-03T10:34:54.388 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-08-03T10:34:54.506 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-08-03T10:34:54.590 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-08-03T10:34:54.694 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-08-03T10:34:54.788 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-08-03T10:34:54.883 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-08-03T10:34:54.977 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-08-03T10:34:55.072 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-08-03T10:34:55.177 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-08-03T10:34:55.260 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-08-03T10:34:55.374 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-08-03T10:34:55.448 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-08-03T10:34:55.573 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-08-03T10:34:55.626 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-08-03T10:34:55.771 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-08-03T10:34:55.824 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-08-03T10:34:55.969 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-08-03T10:34:56.012 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-08-03T10:34:56.158 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-08-03T10:34:56.200 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-08-03T10:34:56.357 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-08-03T10:34:56.389 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-08-03T10:34:56.560 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-08-03T10:34:56.572 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-08-03T10:34:56.759 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-08-03T10:34:56.761 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-08-03T10:34:56.948 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-08-03T10:34:56.959 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-08-03T10:34:57.146 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-08-03T10:34:57.158 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-08-03T10:34:57.354 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-08-03T10:34:57.553 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-08-03T10:34:57.751 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-08-03T10:34:57.948 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-08-03T10:34:58.146 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-08-03T10:34:58.344 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-08-03T10:34:58.543 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-08-03T10:34:58.741 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-08-03T10:34:58.824 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-08-03T10:34:58.929 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-08-03T10:34:59.023 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-08-03T10:34:59.128 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-08-03T10:34:59.213 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-08-03T10:34:59.327 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-08-03T10:34:59.400 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-08-03T10:34:59.525 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-08-03T10:34:59.588 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-08-03T10:34:59.724 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-08-03T10:34:59.787 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-08-03T10:34:59.923 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-08-03T10:34:59.966 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-08-03T10:35:00.122 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-08-03T10:35:00.154 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-08-03T10:35:00.322 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-08-03T10:35:00.354 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-08-03T10:35:00.521 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-08-03T10:35:00.553 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-08-03T10:35:00.722 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-08-03T10:35:00.734 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-08-03T10:35:00.786 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:00 +0000 (0:00:07.075) 0:01:43.574 ******** 2021-08-03T10:35:00.919 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-08-03T10:35:01.117 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-08-03T10:35:01.315 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-08-03T10:35:01.326 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-08-03T10:35:01.328 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "checksum": "41f0b9973307e6d58781b948bc481539828e2674", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "2504cfe296043f68ff0fc227b511d52e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627986900.881425-10313-138511185768532/source", "state": "file", "uid": 0} 2021-08-03T10:35:01.349 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:01 +0000 (0:00:00.562) 0:01:44.137 ******** 2021-08-03T10:35:01.418 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-08-03T10:35:01.420 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => { "msg": "Host smithi101.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-08-03T10:35:01.441 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:01 +0000 (0:00:00.091) 0:01:44.228 ******** 2021-08-03T10:35:01.521 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-08-03T10:35:01.523 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-08-03T10:35:01.545 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:01 +0000 (0:00:00.104) 0:01:44.332 ******** 2021-08-03T10:35:01.614 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-08-03T10:35:01.616 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:01.638 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:01 +0000 (0:00:00.093) 0:01:44.425 ******** 2021-08-03T10:35:02.207 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-08-03T10:35:02.209 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.339121", "end": "2021-08-03 10:35:02.187771", "rc": 0, "start": "2021-08-03 10:35:01.848650", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-08-03T10:35:02.230 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.592) 0:01:45.018 ******** 2021-08-03T10:35:02.300 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-08-03T10:35:02.301 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:02.322 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.091) 0:01:45.110 ******** 2021-08-03T10:35:02.392 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-08-03T10:35:02.393 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:02.413 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.090) 0:01:45.201 ******** 2021-08-03T10:35:02.492 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-08-03T10:35:02.494 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:02.513 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.099) 0:01:45.301 ******** 2021-08-03T10:35:02.591 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:02.614 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.100) 0:01:45.401 ******** 2021-08-03T10:35:02.692 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-08-03T10:35:02.694 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:02.717 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.103) 0:01:45.504 ******** 2021-08-03T10:35:02.785 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-08-03T10:35:02.787 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:02.807 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.090) 0:01:45.595 ******** 2021-08-03T10:35:02.876 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-08-03T10:35:02.878 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi101.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:02.899 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.091) 0:01:45.686 ******** 2021-08-03T10:35:02.936 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:02.938 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-08-03T10:35:02.969 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:02.991 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:02 +0000 (0:00:00.092) 0:01:45.779 ******** 2021-08-03T10:35:03.060 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:03.082 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.090) 0:01:45.870 ******** 2021-08-03T10:35:03.151 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:03.153 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} TASK [common : Set the releasever] ********************************************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:03.175 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.092) 0:01:45.962 ******** 2021-08-03T10:35:03.254 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-08-03T10:35:03.255 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:03.276 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.101) 0:01:46.064 ******** 2021-08-03T10:35:03.356 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:03.357 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-08-03T10:35:03.367 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-08-03T10:35:03.369 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:03.389 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.112) 0:01:46.176 ******** 2021-08-03T10:35:03.468 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi101.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:03.490 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.100) 0:01:46.277 ******** 2021-08-03T10:35:03.558 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:03.561 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:03.582 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.092) 0:01:46.370 ******** 2021-08-03T10:35:03.651 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-08-03T10:35:03.653 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:03.673 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.091) 0:01:46.461 ******** 2021-08-03T10:35:03.742 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-08-03T10:35:03.744 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:03.764 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.090) 0:01:46.552 ******** 2021-08-03T10:35:03.771 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:03.773 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-08-03T10:35:03.835 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:03.861 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.096) 0:01:46.648 ******** 2021-08-03T10:35:03.929 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-08-03T10:35:03.931 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:03.951 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:03 +0000 (0:00:00.090) 0:01:46.739 ******** 2021-08-03T10:35:03.959 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:03.960 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-08-03T10:35:04.023 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.045 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.093) 0:01:46.833 ******** 2021-08-03T10:35:04.115 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.137 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.091) 0:01:46.924 ******** 2021-08-03T10:35:04.154 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:04.155 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-08-03T10:35:04.207 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.229 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.092) 0:01:47.017 ******** 2021-08-03T10:35:04.298 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-08-03T10:35:04.299 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.320 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.090) 0:01:47.107 ******** 2021-08-03T10:35:04.348 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:04.350 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-08-03T10:35:04.390 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-08-03T10:35:04.393 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.413 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.092) 0:01:47.200 ******** 2021-08-03T10:35:04.483 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-08-03T10:35:04.485 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.506 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.093) 0:01:47.294 ******** 2021-08-03T10:35:04.545 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:04.547 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-08-03T10:35:04.581 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi101.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:04.604 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.097) 0:01:47.391 ******** 2021-08-03T10:35:04.673 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-08-03T10:35:04.675 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.695 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.091) 0:01:47.483 ******** 2021-08-03T10:35:04.744 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:04.746 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-08-03T10:35:04.766 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:04.789 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.093) 0:01:47.576 ******** 2021-08-03T10:35:04.942 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-03T10:35:04.944 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-08-03T10:35:04.997 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:04 +0000 (0:00:00.207) 0:01:47.784 ******** 2021-08-03T10:35:05.058 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-08-03T10:35:05.060 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:35:05.086 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:05 +0000 (0:00:00.089) 0:01:47.874 ******** 2021-08-03T10:35:05.567 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-08-03T10:35:05.569 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "checksum": "41f0b9973307e6d58781b948bc481539828e2674", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "2504cfe296043f68ff0fc227b511d52e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627986905.0989451-10830-153701524467796/source", "state": "file", "uid": 0} 2021-08-03T10:35:05.590 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:05 +0000 (0:00:00.503) 0:01:48.377 ******** 2021-08-03T10:35:05.670 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-08-03T10:35:05.672 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => { "msg": "Host smithi003.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-08-03T10:35:05.693 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:05 +0000 (0:00:00.103) 0:01:48.481 ******** 2021-08-03T10:35:05.774 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-08-03T10:35:05.775 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-08-03T10:35:05.796 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:05 +0000 (0:00:00.103) 0:01:48.584 ******** 2021-08-03T10:35:05.866 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-08-03T10:35:05.867 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:05.888 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:05 +0000 (0:00:00.091) 0:01:48.675 ******** 2021-08-03T10:35:05.906 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-08-03T10:35:05.908 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-08-03T10:35:06.334 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-08-03T10:35:06.360 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:06 +0000 (0:00:00.471) 0:01:49.147 ******** 2021-08-03T10:35:06.462 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-08-03T10:35:06.464 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.323174", "end": "2021-08-03 10:35:06.437994", "rc": 0, "start": "2021-08-03 10:35:06.114820", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-08-03T10:35:06.485 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:06 +0000 (0:00:00.125) 0:01:49.273 ******** 2021-08-03T10:35:06.555 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-08-03T10:35:06.557 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:06.583 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:06 +0000 (0:00:00.097) 0:01:49.370 ******** 2021-08-03T10:35:06.674 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:06.698 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:06 +0000 (0:00:00.115) 0:01:49.486 ******** 2021-08-03T10:35:06.768 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-08-03T10:35:06.769 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:06.790 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:06 +0000 (0:00:00.091) 0:01:49.577 ******** 2021-08-03T10:35:06.859 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-08-03T10:35:06.861 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:06.882 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:06 +0000 (0:00:00.091) 0:01:49.669 ******** 2021-08-03T10:35:06.892 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-08-03T10:35:06.893 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-08-03T10:35:06.948 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:06.969 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:06 +0000 (0:00:00.087) 0:01:49.757 ******** 2021-08-03T10:35:07.049 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.072 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.102) 0:01:49.859 ******** 2021-08-03T10:35:07.153 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-08-03T10:35:07.155 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:07.175 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.103) 0:01:49.963 ******** 2021-08-03T10:35:07.244 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-08-03T10:35:07.246 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.267 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.091) 0:01:50.055 ******** 2021-08-03T10:35:07.306 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-08-03T10:35:07.308 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-08-03T10:35:07.332 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.064) 0:01:50.119 ******** 2021-08-03T10:35:07.349 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-08-03T10:35:07.351 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.373 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.040) 0:01:50.160 ******** 2021-08-03T10:35:07.411 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-08-03T10:35:07.413 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.435 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.062) 0:01:50.223 ******** 2021-08-03T10:35:07.456 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-08-03T10:35:07.458 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.480 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.044) 0:01:50.267 ******** 2021-08-03T10:35:07.508 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-08-03T10:35:07.510 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.532 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.051) 0:01:50.319 ******** 2021-08-03T10:35:07.561 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-08-03T10:35:07.563 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:07.585 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.052) 0:01:50.372 ******** 2021-08-03T10:35:07.613 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-08-03T10:35:07.614 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.637 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.052) 0:01:50.424 ******** 2021-08-03T10:35:07.665 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-08-03T10:35:07.667 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.688 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.051) 0:01:50.476 ******** 2021-08-03T10:35:07.716 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-08-03T10:35:07.718 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.740 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.051) 0:01:50.527 ******** 2021-08-03T10:35:07.759 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-08-03T10:35:07.761 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:07.784 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.043) 0:01:50.571 ******** 2021-08-03T10:35:07.833 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-08-03T10:35:07.835 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.835 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.859 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.075) 0:01:50.647 ******** 2021-08-03T10:35:07.866 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-08-03T10:35:07.868 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.890 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.030) 0:01:50.678 ******** 2021-08-03T10:35:07.929 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-08-03T10:35:07.930 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.956 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.065) 0:01:50.744 ******** 2021-08-03T10:35:07.974 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-08-03T10:35:07.975 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:07.997 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:07 +0000 (0:00:00.040) 0:01:50.785 ******** 2021-08-03T10:35:08.025 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-08-03T10:35:08.027 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.049 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.051) 0:01:50.836 ******** 2021-08-03T10:35:08.067 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-08-03T10:35:08.071 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.094 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.044) 0:01:50.881 ******** 2021-08-03T10:35:08.122 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-08-03T10:35:08.124 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.146 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.051) 0:01:50.933 ******** 2021-08-03T10:35:08.163 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-08-03T10:35:08.165 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.187 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.041) 0:01:50.974 ******** 2021-08-03T10:35:08.215 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-08-03T10:35:08.216 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.239 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.051) 0:01:51.026 ******** 2021-08-03T10:35:08.256 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-08-03T10:35:08.258 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:08.280 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.040) 0:01:51.067 ******** 2021-08-03T10:35:08.308 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-08-03T10:35:08.310 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.331 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.051) 0:01:51.119 ******** 2021-08-03T10:35:08.349 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-08-03T10:35:08.351 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.373 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.041) 0:01:51.160 ******** 2021-08-03T10:35:08.442 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-08-03T10:35:08.444 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.465 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.091) 0:01:51.252 ******** 2021-08-03T10:35:08.544 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-08-03T10:35:08.545 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.566 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.101) 0:01:51.353 ******** 2021-08-03T10:35:08.647 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-08-03T10:35:08.649 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.670 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.103) 0:01:51.457 ******** 2021-08-03T10:35:08.748 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-08-03T10:35:08.750 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.770 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.100) 0:01:51.557 ******** 2021-08-03T10:35:08.859 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-08-03T10:35:08.860 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:08.881 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.110) 0:01:51.668 ******** 2021-08-03T10:35:08.961 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-08-03T10:35:08.963 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-03T10:35:08.983 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:08 +0000 (0:00:00.102) 0:01:51.771 ******** 2021-08-03T10:35:09.085 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:09.107 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:09 +0000 (0:00:00.123) 0:01:51.895 ******** 2021-08-03T10:35:09.186 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-08-03T10:35:09.188 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:09.212 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:09 +0000 (0:00:00.105) 0:01:52.000 ******** 2021-08-03T10:35:09.510 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-08-03T10:35:09.512 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:35:09.532 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:09 +0000 (0:00:00.319) 0:01:52.320 ******** 2021-08-03T10:35:09.540 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-08-03T10:35:09.541 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.001287", "end": "2021-08-03 10:35:09.500346", "rc": 0, "start": "2021-08-03 10:35:08.499059", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:35:09.567 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:09 +0000 (0:00:00.034) 0:01:52.354 ******** 2021-08-03T10:35:10.072 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-08-03T10:35:10.074 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-08-03T10:35:10.530 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-08-03T10:35:10.555 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:10 +0000 (0:00:00.988) 0:01:53.342 ******** 2021-08-03T10:35:11.085 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-08-03T10:35:11.087 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-08-03T10:35:11.546 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-08-03T10:35:11.571 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:11 +0000 (0:00:01.016) 0:01:54.358 ******** 2021-08-03T10:35:11.652 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-08-03T10:35:11.654 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:11.674 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:11 +0000 (0:00:00.102) 0:01:54.461 ******** 2021-08-03T10:35:11.743 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-08-03T10:35:11.745 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:11.767 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:11 +0000 (0:00:00.093) 0:01:54.555 ******** 2021-08-03T10:35:11.837 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-08-03T10:35:11.838 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:11.858 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:11 +0000 (0:00:00.090) 0:01:54.646 ******** 2021-08-03T10:35:11.926 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-08-03T10:35:11.928 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:11.951 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:11 +0000 (0:00:00.092) 0:01:54.738 ******** 2021-08-03T10:35:12.032 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-08-03T10:35:12.035 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.045 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.047 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.074 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:12 +0000 (0:00:00.122) 0:01:54.861 ******** 2021-08-03T10:35:12.144 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-08-03T10:35:12.146 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.166 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:12 +0000 (0:00:00.092) 0:01:54.954 ******** 2021-08-03T10:35:12.237 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-08-03T10:35:12.239 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.259 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:12 +0000 (0:00:00.092) 0:01:55.047 ******** 2021-08-03T10:35:12.339 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-08-03T10:35:12.341 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.366 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:12 +0000 (0:00:00.106) 0:01:55.153 ******** 2021-08-03T10:35:12.425 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-08-03T10:35:12.427 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.447 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:12 +0000 (0:00:00.081) 0:01:55.235 ******** 2021-08-03T10:35:12.514 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-08-03T10:35:12.516 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:12.536 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:12 +0000 (0:00:00.089) 0:01:55.324 ******** 2021-08-03T10:35:13.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-08-03T10:35:13.526 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.782893", "end": "2021-08-03 10:35:13.500365", "rc": 0, "start": "2021-08-03 10:35:12.717472", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:35:13.547 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:13 +0000 (0:00:01.010) 0:01:56.334 ******** 2021-08-03T10:35:14.344 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-08-03T10:35:14.346 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:35:14.370 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:14 +0000 (0:00:00.822) 0:01:57.157 ******** 2021-08-03T10:35:14.461 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:14.485 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:14 +0000 (0:00:00.114) 0:01:57.272 ******** 2021-08-03T10:35:14.553 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-08-03T10:35:14.555 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:14.576 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:14 +0000 (0:00:00.091) 0:01:57.363 ******** 2021-08-03T10:35:14.644 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-08-03T10:35:14.646 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:14.668 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:14 +0000 (0:00:00.091) 0:01:57.455 ******** 2021-08-03T10:35:14.736 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-08-03T10:35:14.738 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:14.759 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:14 +0000 (0:00:00.091) 0:01:57.546 ******** 2021-08-03T10:35:15.251 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-08-03T10:35:15.253 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-08-03T10:35:15.274 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:15 +0000 (0:00:00.514) 0:01:58.061 ******** 2021-08-03T10:35:16.815 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-08-03T10:35:16.817 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:35:16.838 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:16 +0000 (0:00:01.563) 0:01:59.625 ******** 2021-08-03T10:35:17.367 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-08-03T10:35:17.369 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-08-03T10:35:17.733 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-08-03T10:35:17.735 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:35:17.756 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:17 +0000 (0:00:00.918) 0:02:00.543 ******** 2021-08-03T10:35:17.815 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-08-03T10:35:17.817 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-08-03T10:35:17.827 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:17.850 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:17 +0000 (0:00:00.093) 0:02:00.637 ******** 2021-08-03T10:35:17.917 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-08-03T10:35:17.919 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:17.940 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:17 +0000 (0:00:00.090) 0:02:00.727 ******** 2021-08-03T10:35:18.009 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-08-03T10:35:18.011 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:18.032 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:18 +0000 (0:00:00.092) 0:02:00.820 ******** 2021-08-03T10:35:18.104 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-08-03T10:35:18.106 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:18.126 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:18 +0000 (0:00:00.094) 0:02:00.914 ******** 2021-08-03T10:35:18.237 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-08-03T10:35:18.239 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-08-03T10:35:18.263 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:18 +0000 (0:00:00.136) 0:02:01.051 ******** 2021-08-03T10:35:18.457 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-08-03T10:35:18.459 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:35:18.479 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:18 +0000 (0:00:00.216) 0:02:01.267 ******** 2021-08-03T10:35:18.642 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-08-03T10:35:18.644 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-08-03T10:35:18.666 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:18 +0000 (0:00:00.186) 0:02:01.453 ******** 2021-08-03T10:35:18.970 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi101.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-08-03T10:35:19.387 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-08-03T10:35:19.849 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627986919.4050272-12360-71172851118225/source", "state": "file", "uid": 0} 2021-08-03T10:35:19.878 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:19 +0000 (0:00:01.212) 0:02:02.665 ******** 2021-08-03T10:35:19.949 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:19.971 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:19 +0000 (0:00:00.093) 0:02:02.759 ******** 2021-08-03T10:35:20.052 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-08-03T10:35:20.053 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-08-03T10:35:20.074 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:20 +0000 (0:00:00.102) 0:02:02.862 ******** 2021-08-03T10:35:20.301 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-08-03T10:35:20.303 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:35:20.323 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:20 +0000 (0:00:00.249) 0:02:03.111 ******** 2021-08-03T10:35:20.330 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-08-03T10:35:20.331 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-08-03T10:35:20.355 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:20 +0000 (0:00:00.031) 0:02:03.143 ******** 2021-08-03T10:35:20.455 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-08-03T10:35:20.457 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:20.467 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:20.489 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:20.500 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:20.522 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:20 +0000 (0:00:00.166) 0:02:03.309 ******** 2021-08-03T10:35:20.861 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-08-03T10:35:20.862 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-08-03T10:35:21.298 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-08-03T10:35:21.736 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-08-03T10:35:21.760 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:21 +0000 (0:00:01.237) 0:02:04.547 ******** 2021-08-03T10:35:21.964 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-08-03T10:35:21.966 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:35:21.987 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:21 +0000 (0:00:00.227) 0:02:04.774 ******** 2021-08-03T10:35:22.483 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-08-03T10:35:22.485 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-08-03T10:35:22.911 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-08-03T10:35:23.412 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627986922.9405055-12667-51661477819355/source", "state": "file", "uid": 0} 2021-08-03T10:35:23.445 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:23 +0000 (0:00:01.458) 0:02:06.233 ******** 2021-08-03T10:35:23.535 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-08-03T10:35:23.537 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:23.559 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:23 +0000 (0:00:00.113) 0:02:06.347 ******** 2021-08-03T10:35:23.639 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-08-03T10:35:23.640 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-08-03T10:35:23.661 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:23 +0000 (0:00:00.101) 0:02:06.448 ******** 2021-08-03T10:35:23.896 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-08-03T10:35:23.898 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-08-03T10:35:23.919 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:23 +0000 (0:00:00.257) 0:02:06.706 ******** 2021-08-03T10:35:23.999 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-08-03T10:35:24.001 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:24.020 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:24.031 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:24.042 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:24.064 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:24 +0000 (0:00:00.145) 0:02:06.852 ******** 2021-08-03T10:35:26.308 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-08-03T10:35:26.310 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-plugins-2.3.3-5.el8.x86_64", "Installed: nrpe-4.0.3-6.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-5.el8.x86_64", "Installed: nagios-common-4.4.6-4.el8.x86_64", "Removed: nagios-common-4.4.5-1.el8.x86_64", "Removed: nagios-plugins-2.3.3-4.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.3-1.el8.x86_64"]} 2021-08-03T10:35:26.332 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:26 +0000 (0:00:02.267) 0:02:09.119 ******** 2021-08-03T10:35:26.400 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-08-03T10:35:26.402 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:26.423 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:26 +0000 (0:00:00.091) 0:02:09.211 ******** 2021-08-03T10:35:26.939 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-08-03T10:35:26.940 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-08-03T10:35:26.962 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:26 +0000 (0:00:00.538) 0:02:09.749 ******** 2021-08-03T10:35:27.447 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-08-03T10:35:27.448 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-08-03T10:35:27.469 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:27 +0000 (0:00:00.506) 0:02:10.256 ******** 2021-08-03T10:35:27.558 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-08-03T10:35:27.560 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:27.569 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:27.592 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:27 +0000 (0:00:00.122) 0:02:10.379 ******** 2021-08-03T10:35:27.826 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-08-03T10:35:27.828 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:35:27.849 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:27 +0000 (0:00:00.257) 0:02:10.636 ******** 2021-08-03T10:35:28.147 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-08-03T10:35:28.149 INFO:teuthology.task.ansible.out:fatal: [smithi101.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-08-03T10:35:28.171 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:28 +0000 (0:00:00.321) 0:02:10.958 ******** 2021-08-03T10:35:28.240 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-08-03T10:35:28.242 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:28.264 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:28 +0000 (0:00:00.093) 0:02:11.052 ******** 2021-08-03T10:35:28.763 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-08-03T10:35:28.765 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-08-03T10:35:28.786 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:28 +0000 (0:00:00.521) 0:02:11.573 ******** 2021-08-03T10:35:29.609 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-08-03T10:35:29.611 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "15754", "ExecMainStartTimestamp": "Tue 2021-08-03 10:35:24 UTC", "ExecMainStartTimestampMonotonic": "154035692", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity" 2021-08-03T10:35:29.613 INFO:teuthology.task.ansible.out:, "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127245", "LimitNPROCSoft": "127245", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127245", "LimitSIGPENDINGSoft": "127245", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "15754", "MemoryAccounting": "yes", "MemoryCurrent": "733184", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203592", "TimeoutStartUSec": "1min 30s", "Tim 2021-08-03T10:35:29.615 INFO:teuthology.task.ansible.out:eoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Tue 2021-08-03 10:35:24 UTC", "WatchdogTimestampMonotonic": "154035718", "WatchdogUSec": "0"}} 2021-08-03T10:35:29.633 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:29 +0000 (0:00:00.847) 0:02:12.420 ******** 2021-08-03T10:35:29.860 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-08-03T10:35:29.862 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001801", "end": "2021-08-03 10:35:29.841346", "rc": 0, "start": "2021-08-03 10:35:29.839545", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-08-03T10:35:29.883 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:29 +0000 (0:00:00.250) 0:02:12.671 ******** 2021-08-03T10:35:30.014 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-08-03T10:35:30.016 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-plugins-2.3.3-5.el8.x86_64", "Installed: nrpe-4.0.3-6.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-5.el8.x86_64", "Installed: nagios-common-4.4.6-4.el8.x86_64", "Removed: nagios-common-4.4.5-1.el8.x86_64", "Removed: nagios-plugins-2.3.3-4.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-4.el8.x86_64", "Removed: nrpe-4.0.3-1.el8.x86_64"]} 2021-08-03T10:35:30.039 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:30 +0000 (0:00:00.155) 0:02:12.826 ******** 2021-08-03T10:35:30.119 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-08-03T10:35:30.121 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:30.140 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:30 +0000 (0:00:00.101) 0:02:12.928 ******** 2021-08-03T10:35:30.676 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-08-03T10:35:30.678 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-08-03T10:35:30.698 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:30 +0000 (0:00:00.557) 0:02:13.486 ******** 2021-08-03T10:35:31.215 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-08-03T10:35:31.217 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-08-03T10:35:31.240 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:31 +0000 (0:00:00.541) 0:02:14.027 ******** 2021-08-03T10:35:31.319 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-08-03T10:35:31.321 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:31.331 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-08-03T10:35:31.353 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:31 +0000 (0:00:00.112) 0:02:14.140 ******** 2021-08-03T10:35:31.432 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-08-03T10:35:31.433 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:35:31.455 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:31 +0000 (0:00:00.102) 0:02:14.243 ******** 2021-08-03T10:35:31.588 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-08-03T10:35:31.590 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:35:31.612 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:31 +0000 (0:00:00.156) 0:02:14.399 ******** 2021-08-03T10:35:31.889 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-08-03T10:35:31.912 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:31 +0000 (0:00:00.300) 0:02:14.699 ******** 2021-08-03T10:35:31.991 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:35:32.013 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:32 +0000 (0:00:00.101) 0:02:14.801 ******** 2021-08-03T10:35:32.529 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-08-03T10:35:32.531 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-08-03T10:35:32.555 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:32 +0000 (0:00:00.541) 0:02:15.342 ******** 2021-08-03T10:35:32.915 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-08-03T10:35:32.917 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "15725", "ExecMainStartTimestamp": "Tue 2021-08-03 10:35:28 UTC", "ExecMainStartTimestampMonotonic": "169725820", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity" 2021-08-03T10:35:32.918 INFO:teuthology.task.ansible.out:, "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127270", "LimitNPROCSoft": "127270", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127270", "LimitSIGPENDINGSoft": "127270", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "15725", "MemoryAccounting": "yes", "MemoryCurrent": "737280", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203632", "TimeoutStartUSec": "1min 30s", "Tim 2021-08-03T10:35:32.920 INFO:teuthology.task.ansible.out:eoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Tue 2021-08-03 10:35:28 UTC", "WatchdogTimestampMonotonic": "169725845", "WatchdogUSec": "0"}} 2021-08-03T10:35:32.938 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:32 +0000 (0:00:00.382) 0:02:15.725 ******** 2021-08-03T10:35:33.172 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-08-03T10:35:33.174 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001820", "end": "2021-08-03 10:35:33.151169", "rc": 0, "start": "2021-08-03 10:35:33.149349", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-08-03T10:35:33.195 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:33 +0000 (0:00:00.256) 0:02:15.982 ******** 2021-08-03T10:35:34.827 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-08-03T10:35:34.829 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:35:34.849 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:35:34 +0000 (0:00:01.654) 0:02:17.637 ******** 2021-08-03T10:36:08.543 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-08-03T10:36:08.546 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8.noarch", "Installed: selinux-policy-3.14.3-67.el8.noarch", "Removed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch"]} 2021-08-03T10:36:08.567 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:08 +0000 (0:00:33.717) 0:02:51.355 ******** 2021-08-03T10:36:09.355 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-08-03T10:36:09.357 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-08-03T10:36:09.377 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:09 +0000 (0:00:00.810) 0:02:52.165 ******** 2021-08-03T10:36:13.118 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-08-03T10:36:13.120 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8.noarch", "Installed: selinux-policy-3.14.3-67.el8.noarch", "Removed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch"]} 2021-08-03T10:36:13.141 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:13 +0000 (0:00:03.763) 0:02:55.929 ******** 2021-08-03T10:36:13.655 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-08-03T10:36:13.657 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-08-03T10:36:13.677 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:13 +0000 (0:00:00.535) 0:02:56.465 ******** 2021-08-03T10:36:24.552 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-08-03T10:36:24.554 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:14.938622", "end": "2021-08-03 10:36:24.527517", "failed_when_result": false, "rc": 0, "start": "2021-08-03 10:36:09.588895", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-08-03T10:36:24.576 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:24 +0000 (0:00:10.898) 0:03:07.363 ******** 2021-08-03T10:36:25.080 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-08-03T10:36:25.082 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-08-03T10:36:25.103 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:25 +0000 (0:00:00.527) 0:03:07.891 ******** 2021-08-03T10:36:25.337 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-08-03T10:36:25.339 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015489", "end": "2021-08-03 10:36:25.320048", "rc": 0, "start": "2021-08-03 10:36:25.304559", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:25.360 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:25 +0000 (0:00:00.256) 0:03:08.147 ******** 2021-08-03T10:36:25.594 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-08-03T10:36:25.596 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.007474", "end": "2021-08-03 10:36:25.573555", "rc": 0, "start": "2021-08-03 10:36:25.566081", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:25.617 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:25 +0000 (0:00:00.257) 0:03:08.405 ******** 2021-08-03T10:36:29.461 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-08-03T10:36:29.463 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:15.555683", "end": "2021-08-03 10:36:29.441492", "failed_when_result": false, "rc": 0, "start": "2021-08-03 10:36:13.885809", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-08-03T10:36:29.489 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:29 +0000 (0:00:03.871) 0:03:12.277 ******** 2021-08-03T10:36:30.007 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-08-03T10:36:30.009 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-08-03T10:36:30.030 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:30 +0000 (0:00:00.540) 0:03:12.817 ******** 2021-08-03T10:36:30.285 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-08-03T10:36:30.287 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.017272", "end": "2021-08-03 10:36:30.259966", "rc": 0, "start": "2021-08-03 10:36:30.242694", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:30.307 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:30 +0000 (0:00:00.277) 0:03:13.095 ******** 2021-08-03T10:36:30.546 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-08-03T10:36:30.548 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.004408", "end": "2021-08-03 10:36:30.525614", "rc": 0, "start": "2021-08-03 10:36:30.521206", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:30.569 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:30 +0000 (0:00:00.260) 0:03:13.355 ******** 2021-08-03T10:36:40.562 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-08-03T10:36:40.564 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:14.717587", "end": "2021-08-03 10:36:40.538397", "rc": 0, "start": "2021-08-03 10:36:25.820810", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:40.586 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:40 +0000 (0:00:10.018) 0:03:23.374 ******** 2021-08-03T10:36:40.821 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-08-03T10:36:40.844 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:40 +0000 (0:00:00.258) 0:03:23.632 ******** 2021-08-03T10:36:40.913 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-08-03T10:36:40.915 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-08-03T10:36:40.939 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:40 +0000 (0:00:00.094) 0:03:23.727 ******** 2021-08-03T10:36:41.018 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-08-03T10:36:41.020 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-08-03T10:36:41.041 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:41 +0000 (0:00:00.102) 0:03:23.829 ******** 2021-08-03T10:36:41.131 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-08-03T10:36:41.133 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "a 2021-08-03T10:36:41.134 INFO:teuthology.task.ansible.out:nsible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-08-03T10:36:41.155 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:41 +0000 (0:00:00.113) 0:03:23.942 ******** 2021-08-03T10:36:41.233 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-08-03T10:36:41.235 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-08-03T10:36:41.256 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:41 +0000 (0:00:00.100) 0:03:24.043 ******** 2021-08-03T10:36:41.448 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-08-03T10:36:41.450 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-08-03T10:36:41.472 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:41 +0000 (0:00:00.216) 0:03:24.260 ******** 2021-08-03T10:36:41.696 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-08-03T10:36:41.698 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-08-03T10:36:41.718 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:41 +0000 (0:00:00.246) 0:03:24.506 ******** 2021-08-03T10:36:41.797 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-08-03T10:36:41.799 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:41.819 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:41 +0000 (0:00:00.100) 0:03:24.607 ******** 2021-08-03T10:36:41.888 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:41.910 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:41 +0000 (0:00:00.090) 0:03:24.698 ******** 2021-08-03T10:36:42.164 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-08-03T10:36:42.166 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-08-03T10:36:42.187 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:42 +0000 (0:00:00.276) 0:03:24.974 ******** 2021-08-03T10:36:42.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-08-03T10:36:42.751 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-08-03T10:36:42.773 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:42 +0000 (0:00:00.586) 0:03:25.561 ******** 2021-08-03T10:36:42.843 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-08-03T10:36:42.845 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi101"}, "changed": false} 2021-08-03T10:36:42.866 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:42 +0000 (0:00:00.092) 0:03:25.653 ******** 2021-08-03T10:36:43.931 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-08-03T10:36:43.933 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi101.front.sepia.ceph.com", "ansible_hostname": "smithi101", "ansible_nodename": "smithi101"}, "changed": true, "name": "smithi101"} 2021-08-03T10:36:43.954 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:43 +0000 (0:00:01.088) 0:03:26.741 ******** 2021-08-03T10:36:44.442 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-08-03T10:36:44.444 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-08-03T10:36:44.464 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:44 +0000 (0:00:00.510) 0:03:27.252 ******** 2021-08-03T10:36:44.965 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-08-03T10:36:44.967 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-08-03T10:36:44.992 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:44 +0000 (0:00:00.527) 0:03:27.779 ******** 2021-08-03T10:36:45.578 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-08-03T10:36:45.580 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-08-03T10:36:45.607 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:45 +0000 (0:00:00.615) 0:03:28.394 ******** 2021-08-03T10:36:46.128 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-08-03T10:36:46.130 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-08-03T10:36:46.159 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.552) 0:03:28.947 ******** 2021-08-03T10:36:46.178 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-08-03T10:36:46.180 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:15.368552", "end": "2021-08-03 10:36:46.153689", "rc": 0, "start": "2021-08-03 10:36:30.785137", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:46.205 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.045) 0:03:28.993 ******** 2021-08-03T10:36:46.391 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-08-03T10:36:46.393 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-08-03T10:36:46.414 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.209) 0:03:29.202 ******** 2021-08-03T10:36:46.452 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-08-03T10:36:46.454 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-08-03T10:36:46.481 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.066) 0:03:29.269 ******** 2021-08-03T10:36:46.550 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-08-03T10:36:46.552 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-08-03T10:36:46.573 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.091) 0:03:29.360 ******** 2021-08-03T10:36:46.641 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-08-03T10:36:46.643 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-08-03T10:36:46.666 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.093) 0:03:29.454 ******** 2021-08-03T10:36:46.674 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-08-03T10:36:46.676 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-08-03T10:36:46.699 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.032) 0:03:29.487 ******** 2021-08-03T10:36:46.789 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-08-03T10:36:46.791 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "a 2021-08-03T10:36:46.793 INFO:teuthology.task.ansible.out:nsible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-08-03T10:36:46.814 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.114) 0:03:29.601 ******** 2021-08-03T10:36:46.894 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-08-03T10:36:46.896 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-08-03T10:36:46.918 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.104) 0:03:29.705 ******** 2021-08-03T10:36:46.958 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-08-03T10:36:46.959 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-08-03T10:36:46.985 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:46 +0000 (0:00:00.066) 0:03:29.772 ******** 2021-08-03T10:36:47.118 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-08-03T10:36:47.119 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-08-03T10:36:47.141 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:47 +0000 (0:00:00.156) 0:03:29.929 ******** 2021-08-03T10:36:47.379 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-08-03T10:36:47.401 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:47 +0000 (0:00:00.259) 0:03:30.189 ******** 2021-08-03T10:36:47.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-08-03T10:36:47.472 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:47.493 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:47 +0000 (0:00:00.091) 0:03:30.281 ******** 2021-08-03T10:36:47.500 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-08-03T10:36:47.502 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-08-03T10:36:47.524 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:47 +0000 (0:00:00.031) 0:03:30.312 ******** 2021-08-03T10:36:47.563 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:47.586 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:47 +0000 (0:00:00.061) 0:03:30.373 ******** 2021-08-03T10:36:47.862 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-08-03T10:36:47.864 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-08-03T10:36:47.884 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:47 +0000 (0:00:00.298) 0:03:30.672 ******** 2021-08-03T10:36:48.027 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-08-03T10:36:48.028 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-08-03T10:36:48.051 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:48 +0000 (0:00:00.166) 0:03:30.839 ******** 2021-08-03T10:36:48.465 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-08-03T10:36:48.467 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-08-03T10:36:48.489 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:48 +0000 (0:00:00.437) 0:03:31.276 ******** 2021-08-03T10:36:48.570 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-08-03T10:36:48.571 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi003"}, "changed": false} 2021-08-03T10:36:48.600 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:48 +0000 (0:00:00.110) 0:03:31.387 ******** 2021-08-03T10:36:49.242 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-08-03T10:36:49.244 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi003.front.sepia.ceph.com", "ansible_hostname": "smithi003", "ansible_nodename": "smithi003"}, "changed": true, "name": "smithi003"} 2021-08-03T10:36:49.265 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:49 +0000 (0:00:00.665) 0:03:32.053 ******** 2021-08-03T10:36:49.771 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-08-03T10:36:49.773 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-08-03T10:36:49.793 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:49 +0000 (0:00:00.528) 0:03:32.581 ******** 2021-08-03T10:36:50.311 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-08-03T10:36:50.313 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-08-03T10:36:50.334 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:50 +0000 (0:00:00.540) 0:03:33.121 ******** 2021-08-03T10:36:50.645 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-08-03T10:36:50.647 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.356357", "end": "2021-08-03 10:36:50.615605", "rc": 0, "start": "2021-08-03 10:36:48.259248", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:50.671 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:50 +0000 (0:00:00.337) 0:03:33.459 ******** 2021-08-03T10:36:50.763 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-08-03T10:36:50.765 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:50.786 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:50 +0000 (0:00:00.114) 0:03:33.574 ******** 2021-08-03T10:36:50.856 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:36:50.858 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:50.878 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:50 +0000 (0:00:00.092) 0:03:33.666 ******** 2021-08-03T10:36:50.917 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-08-03T10:36:50.918 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-08-03T10:36:50.941 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:50 +0000 (0:00:00.062) 0:03:33.728 ******** 2021-08-03T10:36:50.958 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-08-03T10:36:50.960 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-08-03T10:36:50.982 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:50 +0000 (0:00:00.040) 0:03:33.769 ******** 2021-08-03T10:36:51.462 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-08-03T10:36:51.464 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-08-03T10:36:51.485 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:51 +0000 (0:00:00.503) 0:03:34.272 ******** 2021-08-03T10:36:51.514 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-03T10:36:51.516 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-08-03T10:36:51.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-08-03T10:36:51.725 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-08-03T10:36:51.746 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:51 +0000 (0:00:00.260) 0:03:34.533 ******** 2021-08-03T10:36:51.942 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-03T10:36:51.944 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-08-03T10:36:51.986 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-08-03T10:36:51.988 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-08-03T10:36:52.018 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:52 +0000 (0:00:00.272) 0:03:34.805 ******** 2021-08-03T10:36:52.287 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-08-03T10:36:52.289 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-08-03T10:36:52.309 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:52 +0000 (0:00:00.291) 0:03:35.097 ******** 2021-08-03T10:36:52.379 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-03T10:36:52.381 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-08-03T10:36:52.831 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-08-03T10:36:52.833 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-08-03T10:36:52.855 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:52 +0000 (0:00:00.544) 0:03:35.641 ******** 2021-08-03T10:36:52.872 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-03T10:36:52.874 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "md5sum": "0b42b46569ffda9815a0a0455328d06a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987012.4078345-18081-227664165289569/source", "state": "file", "uid": 0} 2021-08-03T10:36:52.899 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:52 +0000 (0:00:00.045) 0:03:35.687 ******** 2021-08-03T10:36:53.398 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-08-03T10:36:53.400 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-08-03T10:36:53.423 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:53 +0000 (0:00:00.523) 0:03:36.211 ******** 2021-08-03T10:36:53.430 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-08-03T10:36:53.433 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-08-03T10:36:53.457 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:53 +0000 (0:00:00.033) 0:03:36.244 ******** 2021-08-03T10:36:53.974 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-08-03T10:36:53.975 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-08-03T10:36:54.401 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-08-03T10:36:54.827 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-08-03T10:36:55.300 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "md5sum": "d96965513d5dae48e1f179ee52900b67", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987014.856911-18359-178588980690312/source", "state": "file", "uid": 0} 2021-08-03T10:36:55.325 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:55 +0000 (0:00:01.868) 0:03:38.112 ******** 2021-08-03T10:36:55.896 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-08-03T10:36:55.898 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.235286", "end": "2021-08-03 10:36:55.868592", "rc": 0, "start": "2021-08-03 10:36:53.633306", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:36:55.920 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:55 +0000 (0:00:00.595) 0:03:38.708 ******** 2021-08-03T10:36:55.949 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-08-03T10:36:55.951 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.385689", "end": "2021-08-03 10:36:55.924944", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-08-03 10:36:55.539255", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'comma 2021-08-03T10:36:55.953 INFO:teuthology.task.ansible.out:nd_warnings=False' in ansible.cfg to get rid of this message. 2021-08-03T10:36:55.975 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:55 +0000 (0:00:00.054) 0:03:38.763 ******** 2021-08-03T10:36:55.992 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-08-03T10:36:55.994 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:56.016 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.040) 0:03:38.804 ******** 2021-08-03T10:36:56.044 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-08-03T10:36:56.046 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:56.068 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.051) 0:03:38.855 ******** 2021-08-03T10:36:56.086 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:36:56.088 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:56.110 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.042) 0:03:38.898 ******** 2021-08-03T10:36:56.149 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-08-03T10:36:56.151 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-08-03T10:36:56.174 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.063) 0:03:38.962 ******** 2021-08-03T10:36:56.203 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-08-03T10:36:56.227 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.052) 0:03:39.014 ******** 2021-08-03T10:36:56.694 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-08-03T10:36:56.696 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.289502", "end": "2021-08-03 10:36:56.676521", "rc": 0, "start": "2021-08-03 10:36:56.387019", "stderr": "", "stderr_lines": [], "stdout": "64 files removed", "stdout_lines": ["64 files removed"]} 2021-08-03T10:36:56.721 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.494) 0:03:39.508 ******** 2021-08-03T10:36:56.761 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-03T10:36:56.762 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-08-03T10:36:56.794 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:36:56.796 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-08-03T10:36:56.817 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.096) 0:03:39.605 ******** 2021-08-03T10:36:56.889 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-08-03T10:36:56.891 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:56.912 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:56 +0000 (0:00:00.094) 0:03:39.699 ******** 2021-08-03T10:36:56.984 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-08-03T10:36:56.987 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:57.007 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:57 +0000 (0:00:00.094) 0:03:39.794 ******** 2021-08-03T10:36:57.213 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-03T10:36:57.215 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-08-03T10:36:57.245 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-08-03T10:36:57.248 INFO:teuthology.task.ansible.out:fatal: [smithi101.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006604", "end": "2021-08-03 10:36:57.221288", "msg": "non-zero return code", "rc": 1, "start": "2021-08-03 10:36:57.214684", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-08-03T10:36:57.268 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:57 +0000 (0:00:00.261) 0:03:40.055 ******** 2021-08-03T10:36:57.336 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-08-03T10:36:57.338 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:36:57.359 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:57 +0000 (0:00:00.091) 0:03:40.146 ******** 2021-08-03T10:36:57.661 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-03T10:36:57.664 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-08-03T10:36:58.167 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "md5sum": "0b42b46569ffda9815a0a0455328d06a", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987017.6893363-18658-117636558829935/source", "state": "file", "uid": 0} 2021-08-03T10:36:58.192 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:58 +0000 (0:00:00.833) 0:03:40.980 ******** 2021-08-03T10:36:58.721 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-08-03T10:36:58.723 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-08-03T10:36:58.745 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:36:58 +0000 (0:00:00.552) 0:03:41.532 ******** 2021-08-03T10:36:59.265 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-08-03T10:36:59.266 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-08-03T10:36:59.720 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-08-03T10:37:00.162 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-08-03T10:37:00.652 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "md5sum": "d96965513d5dae48e1f179ee52900b67", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987020.1875374-18934-28395060104143/source", "state": "file", "uid": 0} 2021-08-03T10:37:00.678 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:00 +0000 (0:00:01.932) 0:03:43.465 ******** 2021-08-03T10:37:01.308 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-08-03T10:37:01.310 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.374005", "end": "2021-08-03 10:37:01.282573", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-08-03 10:37:00.908568", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-08-03T10:37:01.333 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:01 +0000 (0:00:00.655) 0:03:44.120 ******** 2021-08-03T10:37:01.402 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-08-03T10:37:01.404 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:01.424 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:01 +0000 (0:00:00.091) 0:03:44.212 ******** 2021-08-03T10:37:01.505 INFO:teuthology.task.ansible.out: 2021-08-03T10:37:01.506 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:01.517 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:01.540 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:01 +0000 (0:00:00.115) 0:03:44.327 ******** 2021-08-03T10:37:02.089 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-08-03T10:37:02.091 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.312021", "end": "2021-08-03 10:37:02.071090", "rc": 0, "start": "2021-08-03 10:37:01.759069", "stderr": "", "stderr_lines": [], "stdout": "64 files removed", "stdout_lines": ["64 files removed"]} 2021-08-03T10:37:02.111 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:02 +0000 (0:00:00.571) 0:03:44.898 ******** 2021-08-03T10:37:02.179 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:37:02.181 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-08-03T10:37:02.202 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:02 +0000 (0:00:00.091) 0:03:44.990 ******** 2021-08-03T10:37:02.272 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-08-03T10:37:02.274 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:02.294 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:02 +0000 (0:00:00.091) 0:03:45.082 ******** 2021-08-03T10:37:02.363 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-08-03T10:37:02.365 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:02.385 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:02 +0000 (0:00:00.091) 0:03:45.173 ******** 2021-08-03T10:37:02.631 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-08-03T10:37:02.633 INFO:teuthology.task.ansible.out:fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006846", "end": "2021-08-03 10:37:02.606023", "msg": "non-zero return code", "rc": 1, "start": "2021-08-03 10:37:02.599177", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-08-03T10:37:02.654 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:02 +0000 (0:00:00.268) 0:03:45.441 ******** 2021-08-03T10:37:02.733 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-08-03T10:37:02.735 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:02.756 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:02 +0000 (0:00:00.102) 0:03:45.544 ******** 2021-08-03T10:37:15.806 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-08-03T10:37:15.808 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-08-03T10:37:15.829 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:15 +0000 (0:00:13.072) 0:03:58.616 ******** 2021-08-03T10:37:18.686 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-08-03T10:37:18.688 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-08-03T10:37:18.708 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:18 +0000 (0:00:02.879) 0:04:01.496 ******** 2021-08-03T10:37:23.008 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-08-03T10:37:23.010 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-08-03T10:37:23.031 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:23 +0000 (0:00:04.323) 0:04:05.819 ******** 2021-08-03T10:37:25.992 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-08-03T10:37:25.994 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-08-03T10:37:26.014 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:26 +0000 (0:00:02.983) 0:04:08.802 ******** 2021-08-03T10:37:27.565 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-08-03T10:37:27.567 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Installed: dnf-plugins-core-4.0.18-4.el8.noarch", "Installed: yum-utils-4.0.18-4.el8.noarch", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Installed: python3-dnf-plugins-core-4.0.18-4.el8.noarch", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-img-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Removed: dnf-plugins-core-4.0.17-5.el8.noarch", "Removed: yum-utils-4.0.17-5.el8.noarch"]} 2021-08-03T10:37:27.589 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:27 +0000 (0:00:01.574) 0:04:10.376 ******** 2021-08-03T10:37:27.657 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-08-03T10:37:27.659 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:27.679 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:27 +0000 (0:00:00.090) 0:04:10.467 ******** 2021-08-03T10:37:29.438 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-08-03T10:37:29.440 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:37:29.463 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:29 +0000 (0:00:01.783) 0:04:12.251 ******** 2021-08-03T10:37:31.104 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-03T10:37:31.106 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:37:31.127 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:31 +0000 (0:00:01.664) 0:04:13.915 ******** 2021-08-03T10:37:31.480 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-08-03T10:37:31.481 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity 2021-08-03T10:37:31.482 INFO:teuthology.task.ansible.out:", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127245", "LimitNPROCSoft": "127245", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127245", "LimitSIGPENDINGSoft": "127245", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203592", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-08-03T10:37:31.504 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:31 +0000 (0:00:00.376) 0:04:14.292 ******** 2021-08-03T10:37:31.833 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-08-03T10:37:31.835 INFO:teuthology.task.ansible.out:fatal: [smithi101.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-08-03T10:37:31.856 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:31 +0000 (0:00:00.352) 0:04:14.644 ******** 2021-08-03T10:37:32.593 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-08-03T10:37:32.616 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:32 +0000 (0:00:00.759) 0:04:15.403 ******** 2021-08-03T10:37:32.685 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-08-03T10:37:32.687 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:32.708 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:32 +0000 (0:00:00.092) 0:04:15.496 ******** 2021-08-03T10:37:32.777 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-08-03T10:37:32.779 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:32.802 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:32 +0000 (0:00:00.093) 0:04:15.589 ******** 2021-08-03T10:37:32.872 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-08-03T10:37:32.872 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:32.894 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:32 +0000 (0:00:00.092) 0:04:15.682 ******** 2021-08-03T10:37:32.954 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-08-03T10:37:32.956 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:32.977 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:32 +0000 (0:00:00.082) 0:04:15.764 ******** 2021-08-03T10:37:33.046 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-08-03T10:37:33.048 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.068 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.091) 0:04:15.856 ******** 2021-08-03T10:37:33.137 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-08-03T10:37:33.139 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.160 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.091) 0:04:15.947 ******** 2021-08-03T10:37:33.228 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-08-03T10:37:33.250 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.089) 0:04:16.037 ******** 2021-08-03T10:37:33.319 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-08-03T10:37:33.320 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.341 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.091) 0:04:16.129 ******** 2021-08-03T10:37:33.411 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-08-03T10:37:33.413 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.435 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.093) 0:04:16.222 ******** 2021-08-03T10:37:33.505 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-08-03T10:37:33.507 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.516 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.539 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.104) 0:04:16.327 ******** 2021-08-03T10:37:33.610 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-08-03T10:37:33.612 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.632 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.092) 0:04:16.420 ******** 2021-08-03T10:37:33.702 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-08-03T10:37:33.727 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.095) 0:04:16.515 ******** 2021-08-03T10:37:33.796 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-08-03T10:37:33.798 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.821 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.093) 0:04:16.608 ******** 2021-08-03T10:37:33.882 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-08-03T10:37:33.884 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.905 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.083) 0:04:16.692 ******** 2021-08-03T10:37:33.974 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-08-03T10:37:33.977 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:33.997 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:33 +0000 (0:00:00.092) 0:04:16.785 ******** 2021-08-03T10:37:34.058 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-03T10:37:34.060 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.081 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.083) 0:04:16.869 ******** 2021-08-03T10:37:34.141 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-08-03T10:37:34.142 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.170 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.089) 0:04:16.958 ******** 2021-08-03T10:37:34.242 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-08-03T10:37:34.244 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.265 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.094) 0:04:17.052 ******** 2021-08-03T10:37:34.334 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-08-03T10:37:34.335 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.356 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.091) 0:04:17.144 ******** 2021-08-03T10:37:34.425 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-08-03T10:37:34.427 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.447 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.091) 0:04:17.235 ******** 2021-08-03T10:37:34.516 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-08-03T10:37:34.518 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.538 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.090) 0:04:17.326 ******** 2021-08-03T10:37:34.608 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-08-03T10:37:34.610 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.630 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.091) 0:04:17.418 ******** 2021-08-03T10:37:34.699 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-08-03T10:37:34.701 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.721 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.090) 0:04:17.509 ******** 2021-08-03T10:37:34.790 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.813 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.092) 0:04:17.601 ******** 2021-08-03T10:37:34.882 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-08-03T10:37:34.883 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.904 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.090) 0:04:17.692 ******** 2021-08-03T10:37:34.962 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-08-03T10:37:34.964 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:34.984 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:34 +0000 (0:00:00.079) 0:04:17.771 ******** 2021-08-03T10:37:35.053 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.074 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.090) 0:04:17.862 ******** 2021-08-03T10:37:35.143 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-08-03T10:37:35.145 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.165 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.090) 0:04:17.952 ******** 2021-08-03T10:37:35.223 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-08-03T10:37:35.225 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.244 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.079) 0:04:18.032 ******** 2021-08-03T10:37:35.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-08-03T10:37:35.273 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Installed: dnf-plugins-core-4.0.18-4.el8.noarch", "Installed: yum-utils-4.0.18-4.el8.noarch", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Installed: python3-dnf-plugins-core-4.0.18-4.el8.noarch", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-img-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+704+02c27f72.3.x86_64", "Removed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Removed: dnf-plugins-core-4.0.17-5.el8.noarch", "Removed: yum-utils-4.0.17-5.el8.noarch"]} 2021-08-03T10:37:35.296 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.050) 0:04:18.083 ******** 2021-08-03T10:37:35.314 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-08-03T10:37:35.315 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.337 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.041) 0:04:18.124 ******** 2021-08-03T10:37:35.364 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-08-03T10:37:35.366 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.388 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.051) 0:04:18.176 ******** 2021-08-03T10:37:35.406 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-08-03T10:37:35.408 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.431 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.042) 0:04:18.218 ******** 2021-08-03T10:37:35.511 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-08-03T10:37:35.512 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.535 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.103) 0:04:18.322 ******** 2021-08-03T10:37:35.603 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-08-03T10:37:35.605 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.625 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.090) 0:04:18.412 ******** 2021-08-03T10:37:35.693 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-08-03T10:37:35.695 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.715 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.090) 0:04:18.503 ******** 2021-08-03T10:37:35.785 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-08-03T10:37:35.786 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.807 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.091) 0:04:18.595 ******** 2021-08-03T10:37:35.877 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:37:35.879 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.902 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.094) 0:04:18.690 ******** 2021-08-03T10:37:35.971 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:35.994 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:35 +0000 (0:00:00.091) 0:04:18.781 ******** 2021-08-03T10:37:36.063 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-08-03T10:37:36.064 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:36.085 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:36 +0000 (0:00:00.091) 0:04:18.873 ******** 2021-08-03T10:37:36.154 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-03T10:37:36.156 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:36.176 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:36 +0000 (0:00:00.091) 0:04:18.964 ******** 2021-08-03T10:37:36.245 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-08-03T10:37:36.246 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:36.266 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:36 +0000 (0:00:00.089) 0:04:19.054 ******** 2021-08-03T10:37:36.511 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-08-03T10:37:36.512 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-08-03T10:37:36.533 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:36 +0000 (0:00:00.266) 0:04:19.320 ******** 2021-08-03T10:37:36.778 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-08-03T10:37:36.780 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:37:36.800 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:36 +0000 (0:00:00.267) 0:04:19.588 ******** 2021-08-03T10:37:37.037 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-08-03T10:37:37.039 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-08-03T10:37:37.060 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.259) 0:04:19.848 ******** 2021-08-03T10:37:37.129 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-08-03T10:37:37.131 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.151 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.090) 0:04:19.938 ******** 2021-08-03T10:37:37.158 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-08-03T10:37:37.160 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:37:37.182 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.031) 0:04:19.970 ******** 2021-08-03T10:37:37.221 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-08-03T10:37:37.222 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.244 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.061) 0:04:20.032 ******** 2021-08-03T10:37:37.313 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-08-03T10:37:37.315 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.335 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.091) 0:04:20.123 ******** 2021-08-03T10:37:37.404 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-08-03T10:37:37.406 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.429 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.093) 0:04:20.216 ******** 2021-08-03T10:37:37.497 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-08-03T10:37:37.499 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.523 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.094) 0:04:20.310 ******** 2021-08-03T10:37:37.594 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-08-03T10:37:37.595 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.616 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.093) 0:04:20.404 ******** 2021-08-03T10:37:37.696 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.718 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.101) 0:04:20.506 ******** 2021-08-03T10:37:37.802 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-08-03T10:37:37.804 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.825 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.107) 0:04:20.613 ******** 2021-08-03T10:37:37.894 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-08-03T10:37:37.896 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:37.917 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:37 +0000 (0:00:00.091) 0:04:20.704 ******** 2021-08-03T10:37:37.986 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.008 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.091) 0:04:20.796 ******** 2021-08-03T10:37:38.077 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-08-03T10:37:38.079 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.104 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.095) 0:04:20.892 ******** 2021-08-03T10:37:38.173 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-08-03T10:37:38.175 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.195 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.091) 0:04:20.983 ******** 2021-08-03T10:37:38.264 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-08-03T10:37:38.266 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.286 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.090) 0:04:21.074 ******** 2021-08-03T10:37:38.377 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.399 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.113) 0:04:21.187 ******** 2021-08-03T10:37:38.468 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-08-03T10:37:38.470 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.490 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.090) 0:04:21.278 ******** 2021-08-03T10:37:38.570 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-08-03T10:37:38.571 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.595 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.104) 0:04:21.382 ******** 2021-08-03T10:37:38.664 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.686 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.091) 0:04:21.474 ******** 2021-08-03T10:37:38.755 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.778 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.091) 0:04:21.566 ******** 2021-08-03T10:37:38.838 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-08-03T10:37:38.840 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.861 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.082) 0:04:21.649 ******** 2021-08-03T10:37:38.921 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-03T10:37:38.924 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:37:38.946 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.084) 0:04:21.734 ******** 2021-08-03T10:37:38.954 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:38.981 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:38 +0000 (0:00:00.033) 0:04:21.767 ******** 2021-08-03T10:37:39.051 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.074 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.094) 0:04:21.861 ******** 2021-08-03T10:37:39.153 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-08-03T10:37:39.155 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.175 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.101) 0:04:21.963 ******** 2021-08-03T10:37:39.254 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:37:39.256 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-08-03T10:37:39.277 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.101) 0:04:22.065 ******** 2021-08-03T10:37:39.316 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-08-03T10:37:39.317 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity 2021-08-03T10:37:39.318 INFO:teuthology.task.ansible.out:", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127270", "LimitNPROCSoft": "127270", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127270", "LimitSIGPENDINGSoft": "127270", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203632", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-08-03T10:37:39.341 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.063) 0:04:22.128 ******** 2021-08-03T10:37:39.359 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-08-03T10:37:39.361 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.371 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-08-03T10:37:39.372 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.382 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.384 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.393 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.395 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.423 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.081) 0:04:22.210 ******** 2021-08-03T10:37:39.692 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-08-03T10:37:39.694 INFO:teuthology.task.ansible.out:fatal: [smithi003.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003319", "end": "2021-08-03 10:37:39.669702", "rc": 0, "start": "2021-08-03 10:37:39.666383", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology-lock"]} 2021-08-03T10:37:39.716 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.293) 0:04:22.503 ******** 2021-08-03T10:37:39.739 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.023) 0:04:22.527 ******** 2021-08-03T10:37:39.837 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-08-03T10:37:39.839 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.865 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.125) 0:04:22.652 ******** 2021-08-03T10:37:39.945 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:39.967 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:39 +0000 (0:00:00.102) 0:04:22.755 ******** 2021-08-03T10:37:40.038 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-08-03T10:37:40.039 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.060 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.092) 0:04:22.847 ******** 2021-08-03T10:37:40.066 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-08-03T10:37:40.068 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-08-03T10:37:40.091 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.031) 0:04:22.879 ******** 2021-08-03T10:37:40.119 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-08-03T10:37:40.121 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.143 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.052) 0:04:22.931 ******** 2021-08-03T10:37:40.161 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-08-03T10:37:40.162 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.184 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.041) 0:04:22.972 ******** 2021-08-03T10:37:40.264 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-08-03T10:37:40.266 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.287 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.102) 0:04:23.074 ******** 2021-08-03T10:37:40.368 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.390 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.102) 0:04:23.177 ******** 2021-08-03T10:37:40.469 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.491 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.101) 0:04:23.279 ******** 2021-08-03T10:37:40.572 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-08-03T10:37:40.573 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.594 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.103) 0:04:23.382 ******** 2021-08-03T10:37:40.664 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.689 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.094) 0:04:23.476 ******** 2021-08-03T10:37:40.770 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-08-03T10:37:40.797 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.108) 0:04:23.584 ******** 2021-08-03T10:37:40.876 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-08-03T10:37:40.878 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.899 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.102) 0:04:23.687 ******** 2021-08-03T10:37:40.969 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-08-03T10:37:40.971 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:40.991 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:40 +0000 (0:00:00.091) 0:04:23.779 ******** 2021-08-03T10:37:41.082 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-08-03T10:37:41.084 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.109 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.117) 0:04:23.897 ******** 2021-08-03T10:37:41.179 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-08-03T10:37:41.181 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.202 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.092) 0:04:23.990 ******** 2021-08-03T10:37:41.272 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-08-03T10:37:41.302 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.100) 0:04:24.090 ******** 2021-08-03T10:37:41.373 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-08-03T10:37:41.375 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.395 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.093) 0:04:24.183 ******** 2021-08-03T10:37:41.476 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-08-03T10:37:41.478 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.498 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.102) 0:04:24.286 ******** 2021-08-03T10:37:41.579 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-08-03T10:37:41.581 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.609 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.111) 0:04:24.397 ******** 2021-08-03T10:37:41.701 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-03T10:37:41.703 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.725 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.115) 0:04:24.513 ******** 2021-08-03T10:37:41.785 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-08-03T10:37:41.788 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:37:41.817 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.091) 0:04:24.604 ******** 2021-08-03T10:37:41.825 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-08-03T10:37:41.826 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.855 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.038) 0:04:24.643 ******** 2021-08-03T10:37:41.894 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-08-03T10:37:41.896 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930250973184, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227112054, 'block_used': 12983054, 'inode_total': 61054976, 'inode_available': 60985731, 'inode_used': 69245, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227112054, "block_size": 4096, "block_total": 240095108, "block_used": 12983054, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985731, "inode_total": 61054976, "inode_used": 69245, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930250973184, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}} 2021-08-03T10:37:41.919 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.063) 0:04:24.706 ******** 2021-08-03T10:37:41.937 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:41.961 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:41 +0000 (0:00:00.041) 0:04:24.748 ******** 2021-08-03T10:37:42.041 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-08-03T10:37:42.043 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.075 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.113) 0:04:24.862 ******** 2021-08-03T10:37:42.147 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-08-03T10:37:42.149 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.169 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.094) 0:04:24.957 ******** 2021-08-03T10:37:42.178 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-08-03T10:37:42.181 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005081", "end": "2021-08-03 10:37:42.134387", "rc": 0, "start": "2021-08-03 10:37:42.129306", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:42.208 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.038) 0:04:24.996 ******** 2021-08-03T10:37:42.237 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-08-03T10:37:42.238 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.265 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.055) 0:04:25.051 ******** 2021-08-03T10:37:42.313 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-08-03T10:37:42.315 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930250973184, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227112054, 'block_used': 12983054, 'inode_total': 61054976, 'inode_available': 60985731, 'inode_used': 69245, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227112054, "block_size": 4096, "block_total": 240095108, "block_used": 12983054, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985731, "inode_total": 61054976, "inode_used": 69245, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930250973184, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.347 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.082) 0:04:25.134 ******** 2021-08-03T10:37:42.355 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-08-03T10:37:42.357 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.380 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.032) 0:04:25.167 ******** 2021-08-03T10:37:42.408 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-08-03T10:37:42.432 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.052) 0:04:25.220 ******** 2021-08-03T10:37:42.450 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-08-03T10:37:42.452 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.477 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.044) 0:04:25.264 ******** 2021-08-03T10:37:42.539 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-08-03T10:37:42.541 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.562 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.084) 0:04:25.349 ******** 2021-08-03T10:37:42.633 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-08-03T10:37:42.636 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.655 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.093) 0:04:25.443 ******** 2021-08-03T10:37:42.725 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-08-03T10:37:42.726 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.747 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.091) 0:04:25.534 ******** 2021-08-03T10:37:42.806 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-08-03T10:37:42.808 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.829 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.082) 0:04:25.617 ******** 2021-08-03T10:37:42.899 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-08-03T10:37:42.901 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:42.922 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:42 +0000 (0:00:00.092) 0:04:25.709 ******** 2021-08-03T10:37:43.161 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-08-03T10:37:43.163 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:43.185 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:43 +0000 (0:00:00.262) 0:04:25.972 ******** 2021-08-03T10:37:43.403 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-08-03T10:37:43.405 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:43.426 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:43 +0000 (0:00:00.241) 0:04:26.213 ******** 2021-08-03T10:37:43.643 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-08-03T10:37:43.645 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:43.665 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:43 +0000 (0:00:00.238) 0:04:26.452 ******** 2021-08-03T10:37:43.902 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-08-03T10:37:43.904 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:43.924 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:43 +0000 (0:00:00.259) 0:04:26.711 ******** 2021-08-03T10:37:43.994 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-08-03T10:37:43.997 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.020 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.095) 0:04:26.807 ******** 2021-08-03T10:37:44.089 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-08-03T10:37:44.091 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.111 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.091) 0:04:26.898 ******** 2021-08-03T10:37:44.201 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-08-03T10:37:44.203 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.224 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.113) 0:04:27.012 ******** 2021-08-03T10:37:44.295 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:37:44.297 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.317 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.093) 0:04:27.105 ******** 2021-08-03T10:37:44.327 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkdI9cBiAYhPkMvSikT4aNFWGs0mMKZrGN'], 'uuids': ['2314e85a-57bf-40b8-97da-c697f4ef771c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.635311", "end": "2021-08-03 10:37:44.288955", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkdI9cBiAYhPkMvSikT4aNFWGs0mMKZrGN"], "labels": [], "masters": [], "uuids": ["2314e85a-57bf-40b8-97da-c697f4ef771c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:42.653644", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2021-08-03T10:37:44.329 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2021-08-03T10:37:44.384 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.407 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.089) 0:04:27.194 ******** 2021-08-03T10:37:44.477 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-08-03T10:37:44.481 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.499 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.092) 0:04:27.286 ******** 2021-08-03T10:37:44.568 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-03T10:37:44.570 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.591 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.092) 0:04:27.378 ******** 2021-08-03T10:37:44.810 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-08-03T10:37:44.812 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:44.842 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:44 +0000 (0:00:00.250) 0:04:27.629 ******** 2021-08-03T10:37:45.248 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-08-03T10:37:45.250 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-08-03T10:37:45.272 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:45 +0000 (0:00:00.430) 0:04:28.059 ******** 2021-08-03T10:37:45.554 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:45.555 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-b1HlBK-lz8v-th1s-qf1i-L4WJ-rExv-JpmqSU', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204017B400BGN', 'nvme-nvme.8086-50484654363230343031374234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.052051", "end": "2021-08-03 10:37:45.523705", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-b1HlBK-lz8v-th1s-qf1i-L4WJ-rExv-JpmqSU", "nvme-INTEL_SSDPEDMD400G4_PHFT6204017B400BGN", "nvme-nvme.8086-50484654363230343031374234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:44.471654", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-08-03T10:37:45.557 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:45.672 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-08-03T10:37:45.674 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:37:45.695 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:45 +0000 (0:00:00.422) 0:04:28.482 ******** 2021-08-03T10:37:46.095 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-08-03T10:37:46.097 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-08-03T10:37:46.270 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.575) 0:04:29.057 ******** 2021-08-03T10:37:46.339 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:46.363 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.093) 0:04:29.151 ******** 2021-08-03T10:37:46.433 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-08-03T10:37:46.435 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:46.455 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.092) 0:04:29.243 ******** 2021-08-03T10:37:46.525 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-08-03T10:37:46.527 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:46.547 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.091) 0:04:29.335 ******** 2021-08-03T10:37:46.616 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-08-03T10:37:46.618 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:46.638 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.091) 0:04:29.426 ******** 2021-08-03T10:37:46.709 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-08-03T10:37:46.711 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:46.731 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.092) 0:04:29.519 ******** 2021-08-03T10:37:46.822 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-08-03T10:37:46.824 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:46.846 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.114) 0:04:29.633 ******** 2021-08-03T10:37:46.854 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:46.855 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkLNkpa7hPg518Bx2fQLfsBx3ZEPfoxeNw'], 'uuids': ['1303b074-b256-4ee0-a339-c07283a5b8c0'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.083563", "end": "2021-08-03 10:37:46.798475", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkLNkpa7hPg518Bx2fQLfsBx3ZEPfoxeNw"], "labels": [], "masters": [], "uuids": ["1303b074-b256-4ee0-a339-c07283a5b8c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:45.714912", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:46.920 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:46.944 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:46 +0000 (0:00:00.098) 0:04:29.731 ******** 2021-08-03T10:37:47.015 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-08-03T10:37:47.017 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.038 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.093) 0:04:29.825 ******** 2021-08-03T10:37:47.117 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-08-03T10:37:47.119 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.140 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.101) 0:04:29.927 ******** 2021-08-03T10:37:47.230 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-08-03T10:37:47.232 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.253 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.113) 0:04:30.040 ******** 2021-08-03T10:37:47.322 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-08-03T10:37:47.324 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.347 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.094) 0:04:30.135 ******** 2021-08-03T10:37:47.417 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-08-03T10:37:47.419 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.442 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.094) 0:04:30.230 ******** 2021-08-03T10:37:47.514 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-08-03T10:37:47.515 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.541 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.098) 0:04:30.328 ******** 2021-08-03T10:37:47.613 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-08-03T10:37:47.615 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.636 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.095) 0:04:30.424 ******** 2021-08-03T10:37:47.706 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.728 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.092) 0:04:30.516 ******** 2021-08-03T10:37:47.797 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-08-03T10:37:47.799 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.819 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.090) 0:04:30.606 ******** 2021-08-03T10:37:47.901 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:47.925 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:47 +0000 (0:00:00.105) 0:04:30.712 ******** 2021-08-03T10:37:47.993 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-08-03T10:37:47.995 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:48.015 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.091) 0:04:30.803 ******** 2021-08-03T10:37:48.054 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:48.056 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkM9MRI9BCGNLkO281CzV5NuxCzAJehUKz'], 'uuids': ['6c8d586e-afd5-4fd9-b31a-f92c3ca6d726'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.044207", "end": "2021-08-03 10:37:48.026266", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkM9MRI9BCGNLkO281CzV5NuxCzAJehUKz"], "labels": [], "masters": [], "uuids": ["6c8d586e-afd5-4fd9-b31a-f92c3ca6d726"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:46.982059", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:48.097 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:48.120 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.104) 0:04:30.907 ******** 2021-08-03T10:37:48.189 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-08-03T10:37:48.190 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:48.211 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.091) 0:04:30.998 ******** 2021-08-03T10:37:48.281 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-08-03T10:37:48.283 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:48.305 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.093) 0:04:31.092 ******** 2021-08-03T10:37:48.405 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-08-03T10:37:48.407 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:48.428 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.123) 0:04:31.216 ******** 2021-08-03T10:37:48.508 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:37:48.509 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-08-03T10:37:48.530 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.101) 0:04:31.317 ******** 2021-08-03T10:37:48.610 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi003.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-08-03T10:37:48.621 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-08-03T10:37:48.683 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.152) 0:04:31.470 ******** 2021-08-03T10:37:48.917 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-08-03T10:37:48.919 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003269", "end": "2021-08-03 10:37:48.898850", "rc": 0, "start": "2021-08-03 10:37:48.895581", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology-lock"]} 2021-08-03T10:37:48.942 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:48 +0000 (0:00:00.259) 0:04:31.730 ******** 2021-08-03T10:37:49.011 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-08-03T10:37:49.013 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:49.036 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:49 +0000 (0:00:00.093) 0:04:31.823 ******** 2021-08-03T10:37:49.105 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-08-03T10:37:49.106 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:49.128 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:49 +0000 (0:00:00.091) 0:04:31.915 ******** 2021-08-03T10:37:49.197 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-08-03T10:37:49.199 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:49.228 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:49 +0000 (0:00:00.100) 0:04:32.015 ******** 2021-08-03T10:37:49.300 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:49.323 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:49 +0000 (0:00:00.095) 0:04:32.110 ******** 2021-08-03T10:37:49.332 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:49.333 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkZbD1s51rKJ98Gdh37bvI5TK93AJN0ZOM'], 'uuids': ['02e0d214-085b-44ce-a64d-a2493bc96f45'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.077650", "end": "2021-08-03 10:37:49.285147", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkZbD1s51rKJ98Gdh37bvI5TK93AJN0ZOM"], "labels": [], "masters": [], "uuids": ["02e0d214-085b-44ce-a64d-a2493bc96f45"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:48.207497", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:49.335 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCGY', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QCGY', 'scsi-35000c50091e05c18', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY', 'wwn-0x5000c50091e05c18'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QCGY', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e05c18', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCGY-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QCGY-part1', 'scsi-35000c50091e05c18-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY-part1', 'wwn-0x5000c50091e05c18-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCGY", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QCGY", "scsi-35000c50091e05c18", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY", "wwn-0x5000c50091e05c18"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCGY-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-08-03T10:37:49.336 INFO:teuthology.task.ansible.out:Z1W5QCGY-part1", "scsi-35000c50091e05c18-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY-part1", "wwn-0x5000c50091e05c18-part1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QCGY", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e05c18"}}, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:50.706 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkYL9Se0UyUeQUQDABdhwGANZdXDJuCsGo'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.060586", "end": "2021-08-03 10:37:50.677636", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkYL9Se0UyUeQUQDABdhwGANZdXDJuCsGo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:49.617050", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:50.735 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:50 +0000 (0:00:01.412) 0:04:33.523 ******** 2021-08-03T10:37:51.046 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-08-03T10:37:51.048 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:37:51.068 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:51 +0000 (0:00:00.332) 0:04:33.856 ******** 2021-08-03T10:37:51.147 INFO:teuthology.task.ansible.out: 2021-08-03T10:37:51.149 INFO:teuthology.task.ansible.out:TASK [testnode : Set root disk] ************************************************ ok: [smithi003.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930250903552, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227112037, 'block_used': 12983071, 'inode_total': 61054976, 'inode_available': 60985739, 'inode_used': 69237, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227112037, "block_size": 4096, "block_total": 240095108, "block_used": 12983071, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985739, "inode_total": 61054976, "inode_used": 69237, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930250903552, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}} 2021-08-03T10:37:51.150 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-03T10:37:51.151 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkdI9cBiAYhPkMvSikT4aNFWGs0mMKZrGN'], 'uuids': ['2314e85a-57bf-40b8-97da-c697f4ef771c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.146033", "end": "2021-08-03 10:37:51.124528", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkdI9cBiAYhPkMvSikT4aNFWGs0mMKZrGN"], "labels": [] 2021-08-03T10:37:51.153 INFO:teuthology.task.ansible.out:, "masters": [], "uuids": ["2314e85a-57bf-40b8-97da-c697f4ef771c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:50.978495", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143284 s, 805 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143284 s, 805 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:51.173 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:51 +0000 (0:00:00.105) 0:04:33.961 ******** 2021-08-03T10:37:51.369 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-b1HlBK-lz8v-th1s-qf1i-L4WJ-rExv-JpmqSU', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204017B400BGN', 'nvme-nvme.8086-50484654363230343031374234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.040881", "end": "2021-08-03 10:37:51.339524", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-b1HlBK-lz8v-th1s-qf1i-L4WJ-rExv-JpmqSU", "nvme-INTEL_SSDPEDMD400G4_PHFT6204017B400BGN", "nvme-nvme.8086-50484654363230343031374234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:51.298643", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0380026 s, 3.0 GB/s", "std 2021-08-03T10:37:51.371 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0380026 s, 3.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:51.421 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-08-03T10:37:51.423 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005425", "end": "2021-08-03 10:37:51.396967", "rc": 0, "start": "2021-08-03 10:37:51.391542", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:51.443 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:51 +0000 (0:00:00.270) 0:04:34.231 ******** 2021-08-03T10:37:51.522 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-08-03T10:37:51.524 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930250903552, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227112037, 'block_used': 12983071, 'inode_total': 61054976, 'inode_available': 60985739, 'inode_used': 69237, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227112037, "block_size": 4096, "block_total": 240095108, "block_used": 12983071, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985739, "inode_total": 61054976, "inode_used": 69237, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930250903552, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:51.545 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:51 +0000 (0:00:00.102) 0:04:34.333 ******** 2021-08-03T10:37:51.614 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-08-03T10:37:51.636 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:51 +0000 (0:00:00.090) 0:04:34.424 ******** 2021-08-03T10:37:51.695 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-03T10:37:51.696 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkLNkpa7hPg518Bx2fQLfsBx3ZEPfoxeNw'], 'uuids': ['1303b074-b256-4ee0-a339-c07283a5b8c0'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.146017", "end": "2021-08-03 10:37:51.662956", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkLNkpa7hPg518Bx2fQLfsBx3ZEPfoxeNw"], "labels": [], "masters": [], "uuids": ["1303b074-b256-4ee0-a339-c07283a5b8c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:51.516939", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143304 s, 805 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143304 s, 805 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:52.006 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkM9MRI9BCGNLkO281CzV5NuxCzAJehUKz'], 'uuids': ['6c8d586e-afd5-4fd9-b31a-f92c3ca6d726'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.144942", "end": "2021-08-03 10:37:51.981071", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkM9MRI9BCGNLkO281CzV5NuxCzAJehUKz"], "labels": [], "masters": [], "uuids": ["6c8d586e-afd5-4fd9-b31a-f92c3ca6d726"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:51.836129", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142314 s, 810 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142314 s, 810 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:52.330 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkZbD1s51rKJ98Gdh37bvI5TK93AJN0ZOM'], 'uuids': ['02e0d214-085b-44ce-a64d-a2493bc96f45'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.155558", "end": "2021-08-03 10:37:52.305352", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkZbD1s51rKJ98Gdh37bvI5TK93AJN0ZOM"], "labels": [], "masters": [], "uuids": ["02e0d214-085b-44ce-a64d-a2493bc96f45"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:52.149794", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152861 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152861 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:52.344 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCGY', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QCGY', 'scsi-35000c50091e05c18', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY', 'wwn-0x5000c50091e05c18'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QCGY', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e05c18', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QCGY-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QCGY-part1', 'scsi-35000c50091e05c18-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY-part1', 'wwn-0x5000c50091e05c18-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCGY", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QCGY", "scsi-35000c50091e05c18", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY", "wwn-0x5000c50091e05c18"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCGY-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QCGY-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-08-03T10:37:52.345 INFO:teuthology.task.ansible.out:Z1W5QCGY-part1", "scsi-35000c50091e05c18-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QCGY-part1", "wwn-0x5000c50091e05c18-part1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QCGY", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e05c18"}}, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:52.658 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkYL9Se0UyUeQUQDABdhwGANZdXDJuCsGo'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.144977", "end": "2021-08-03 10:37:52.628518", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7x27LE22PMKTLzaqYq84tTjqQdQ9JyqkYL9Se0UyUeQUQDABdhwGANZdXDJuCsGo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:52.483541", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142375 s, 810 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142375 s, 810 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:52.695 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:52 +0000 (0:00:01.059) 0:04:35.483 ******** 2021-08-03T10:37:52.982 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi101.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.051595", "end": "2021-08-03 10:37:52.907331", "rc": 0, "start": "2021-08-03 10:37:52.855736", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:53.003 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.307) 0:04:35.790 ******** 2021-08-03T10:37:53.229 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-08-03T10:37:53.231 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043519", "end": "2021-08-03 10:37:53.203573", "rc": 0, "start": "2021-08-03 10:37:53.160054", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:37:53.251 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.248) 0:04:36.039 ******** 2021-08-03T10:37:53.310 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:53.312 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyG8FQwMFnCFWhb6u2MvdsXZPEO3fBRfWfy'], 'uuids': ['210e6065-f26d-4700-8abb-657ce0ef9cdc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.409575", "end": "2021-08-03 10:37:53.275615", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyG8FQwMFnCFWhb6u2MvdsXZPEO3fBRfWfy"], "labels": [], "masters": [], "uuids": ["210e6065-f26d-4700-8abb-657ce0ef9cdc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:51.866040", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:53.322 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-08-03T10:37:53.387 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.136) 0:04:36.175 ******** 2021-08-03T10:37:53.420 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-08-03T10:37:53.422 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:53.447 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.059) 0:04:36.234 ******** 2021-08-03T10:37:53.474 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-08-03T10:37:53.476 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:53.498 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.050) 0:04:36.285 ******** 2021-08-03T10:37:53.525 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-08-03T10:37:53.527 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:53.556 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.058) 0:04:36.343 ******** 2021-08-03T10:37:53.584 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:53.608 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.052) 0:04:36.396 ******** 2021-08-03T10:37:53.803 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-08-03T10:37:53.805 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:37:53.827 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.218) 0:04:36.615 ******** 2021-08-03T10:37:53.887 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-08-03T10:37:53.889 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930250973184, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227112054, 'block_used': 12983054, 'inode_total': 61054976, 'inode_available': 60985731, 'inode_used': 69245, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227112054, "block_size": 4096, "block_total": 240095108, "block_used": 12983054, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985731, "inode_total": 61054976, "inode_used": 69245, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930250973184, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:53.919 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.092) 0:04:36.707 ******** 2021-08-03T10:37:53.947 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-08-03T10:37:53.949 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:53.970 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:53 +0000 (0:00:00.050) 0:04:36.758 ******** 2021-08-03T10:37:53.999 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:37:54.001 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:54.028 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:54 +0000 (0:00:00.057) 0:04:36.815 ******** 2021-08-03T10:37:54.056 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:37:54.057 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:54.078 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:54 +0000 (0:00:00.050) 0:04:36.866 ******** 2021-08-03T10:37:54.106 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-08-03T10:37:54.107 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:54.128 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:54 +0000 (0:00:00.049) 0:04:36.916 ******** 2021-08-03T10:37:54.155 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-08-03T10:37:54.157 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:54.177 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:54 +0000 (0:00:00.049) 0:04:36.965 ******** 2021-08-03T10:37:54.205 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-08-03T10:37:54.206 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:54.228 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:54 +0000 (0:00:00.050) 0:04:37.016 ******** 2021-08-03T10:37:54.563 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:54.565 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YN5k8i-h9tw-XX9v-AkKj-0Tdx-xL7G-mv9k9W', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN', 'nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.057516", "end": "2021-08-03 10:37:54.528821", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-YN5k8i-h9tw-XX9v-AkKj-0Tdx-xL7G-mv9k9W", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN", "nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:53.471305", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-08-03T10:37:54.567 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:54.825 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-08-03T10:37:54.827 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-08-03T10:37:54.851 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:54 +0000 (0:00:00.622) 0:04:37.639 ******** 2021-08-03T10:37:55.369 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-08-03T10:37:55.371 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:37:55.718 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:37:55.812 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:55.814 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGSLjTbAUymAOdfEBcwjYk2hg1Q3Mek34C'], 'uuids': ['0fd31e2d-1755-4c05-af67-c188f21cc212'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.049884", "end": "2021-08-03 10:37:55.777987", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGSLjTbAUymAOdfEBcwjYk2hg1Q3Mek34C"], "labels": [], "masters": [], "uuids": ["0fd31e2d-1755-4c05-af67-c188f21cc212"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:54.728103", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:56.054 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-08-03T10:37:56.056 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:37:56.418 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:37:56.761 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:37:56.785 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:56 +0000 (0:00:01.933) 0:04:39.572 ******** 2021-08-03T10:37:56.980 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-08-03T10:37:56.982 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-08-03T10:37:57.003 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:57 +0000 (0:00:00.218) 0:04:39.790 ******** 2021-08-03T10:37:57.061 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:57.062 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGj9567tUjVdujvuwleCBAtHv8ED2tSwaz'], 'uuids': ['6503dc80-c2b6-4f2a-852c-74b8bcf988e4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.052641", "end": "2021-08-03 10:37:57.024904", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGj9567tUjVdujvuwleCBAtHv8ED2tSwaz"], "labels": [], "masters": [], "uuids": ["6503dc80-c2b6-4f2a-852c-74b8bcf988e4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:55.972263", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:57.207 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-08-03T10:37:57.209 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-03T10:37:57.376 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-03T10:37:57.553 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-03T10:37:57.720 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-03T10:37:57.731 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:57.756 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:57 +0000 (0:00:00.753) 0:04:40.543 ******** 2021-08-03T10:37:57.783 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-08-03T10:37:57.784 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:57.804 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:57 +0000 (0:00:00.048) 0:04:40.592 ******** 2021-08-03T10:37:57.830 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:57.851 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:57 +0000 (0:00:00.046) 0:04:40.638 ******** 2021-08-03T10:37:58.043 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-08-03T10:37:58.045 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:37:58.065 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:58 +0000 (0:00:00.213) 0:04:40.852 ******** 2021-08-03T10:37:58.102 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-08-03T10:37:58.127 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:58 +0000 (0:00:00.062) 0:04:40.915 ******** 2021-08-03T10:37:58.312 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:58.314 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGh8W1LigO8ZdWfDtS97OP1dVJPNjT4iF0'], 'uuids': ['1863c2af-f895-4417-aaf7-74fa285e6b5b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.062610", "end": "2021-08-03 10:37:58.284041", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGh8W1LigO8ZdWfDtS97OP1dVJPNjT4iF0"], "labels": [], "masters": [], "uuids": ["1863c2af-f895-4417-aaf7-74fa285e6b5b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:57.221431", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:58.325 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-35000c500871a3370', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7', 'wwn-0x5000c500871a3370'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HRN7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a3370', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-35000c500871a3370-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'wwn-0x5000c500871a3370-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-35000c500871a3370", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7", "wwn-0x5000c500871a3370"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-08-03T10:37:58.326 INFO:teuthology.task.ansible.out:Z1W4HRN7-part1", "scsi-35000c500871a3370-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "wwn-0x5000c500871a3370-part1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRN7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a3370"}}, "skip_reason": "Conditional result was False"} 2021-08-03T10:37:59.557 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi101.front.sepia.ceph.com] => {"changed": true} 2021-08-03T10:37:59.581 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:59 +0000 (0:00:01.453) 0:04:42.368 ******** 2021-08-03T10:37:59.588 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-03T10:37:59.589 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGE6tf9ahKGcGUA6XqUbzXKnsRMPdD3Skx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.057101", "end": "2021-08-03 10:37:59.540929", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGE6tf9ahKGcGUA6XqUbzXKnsRMPdD3Skx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:58.483828", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-03T10:37:59.621 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:37:59 +0000 (0:00:00.040) 0:04:42.409 ******** 2021-08-03T10:37:59.996 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-03T10:37:59.998 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyG8FQwMFnCFWhb6u2MvdsXZPEO3fBRfWfy'], 'uuids': ['210e6065-f26d-4700-8abb-657ce0ef9cdc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140648", "end": "2021-08-03 10:37:59.967347", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyG8FQwMFnCFWhb6u2MvdsXZPEO3fBRfWfy"], "labels": [], "masters": [], "uuids": ["210e6065-f26d-4700-8abb-657ce0ef9cdc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:37:59.826699", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137795 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137795 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:00.039 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-08-03T10:38:00.041 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-08-03T10:38:00.062 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.441) 0:04:42.850 ******** 2021-08-03T10:38:00.090 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-08-03T10:38:00.091 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.113 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.050) 0:04:42.901 ******** 2021-08-03T10:38:00.141 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-08-03T10:38:00.142 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.163 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.049) 0:04:42.950 ******** 2021-08-03T10:38:00.190 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-08-03T10:38:00.192 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.213 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.050) 0:04:43.001 ******** 2021-08-03T10:38:00.221 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-03T10:38:00.222 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YN5k8i-h9tw-XX9v-AkKj-0Tdx-xL7G-mv9k9W', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN', 'nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.039780", "end": "2021-08-03 10:38:00.186094", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-YN5k8i-h9tw-XX9v-AkKj-0Tdx-xL7G-mv9k9W", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN", "nvme-nvme.8086-43564654353333303030395a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:38:00.146314", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0369122 s, 3.1 GB/s", "std 2021-08-03T10:38:00.224 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0369122 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:00.235 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-08-03T10:38:00.236 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.258 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.044) 0:04:43.045 ******** 2021-08-03T10:38:00.286 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-08-03T10:38:00.288 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.317 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.058) 0:04:43.104 ******** 2021-08-03T10:38:00.345 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-08-03T10:38:00.347 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.370 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.052) 0:04:43.157 ******** 2021-08-03T10:38:00.397 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-08-03T10:38:00.399 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.421 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.051) 0:04:43.209 ******** 2021-08-03T10:38:00.451 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-08-03T10:38:00.452 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.476 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.054) 0:04:43.263 ******** 2021-08-03T10:38:00.503 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.525 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.049) 0:04:43.313 ******** 2021-08-03T10:38:00.552 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-03T10:38:00.554 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGSLjTbAUymAOdfEBcwjYk2hg1Q3Mek34C'], 'uuids': ['0fd31e2d-1755-4c05-af67-c188f21cc212'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.155296", "end": "2021-08-03 10:38:00.524247", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGSLjTbAUymAOdfEBcwjYk2hg1Q3Mek34C"], "labels": [], "masters": [], "uuids": ["0fd31e2d-1755-4c05-af67-c188f21cc212"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:38:00.368951", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15253 s, 756 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15253 s, 756 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.576 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.050) 0:04:43.363 ******** 2021-08-03T10:38:00.603 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-08-03T10:38:00.605 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.624 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.048) 0:04:43.412 ******** 2021-08-03T10:38:00.651 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-08-03T10:38:00.653 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.673 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.048) 0:04:43.461 ******** 2021-08-03T10:38:00.700 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-08-03T10:38:00.702 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.722 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.049) 0:04:43.510 ******** 2021-08-03T10:38:00.749 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-08-03T10:38:00.750 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.771 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.048) 0:04:43.559 ******** 2021-08-03T10:38:00.802 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-08-03T10:38:00.804 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:00.824 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:00 +0000 (0:00:00.052) 0:04:43.611 ******** 2021-08-03T10:38:00.871 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-03T10:38:00.873 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGj9567tUjVdujvuwleCBAtHv8ED2tSwaz'], 'uuids': ['6503dc80-c2b6-4f2a-852c-74b8bcf988e4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.143694", "end": "2021-08-03 10:38:00.842998", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGj9567tUjVdujvuwleCBAtHv8ED2tSwaz"], "labels": [], "masters": [], "uuids": ["6503dc80-c2b6-4f2a-852c-74b8bcf988e4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:38:00.699304", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140952 s, 818 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140952 s, 818 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:01.196 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGh8W1LigO8ZdWfDtS97OP1dVJPNjT4iF0'], 'uuids': ['1863c2af-f895-4417-aaf7-74fa285e6b5b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.144471", "end": "2021-08-03 10:38:01.164657", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGh8W1LigO8ZdWfDtS97OP1dVJPNjT4iF0"], "labels": [], "masters": [], "uuids": ["1863c2af-f895-4417-aaf7-74fa285e6b5b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:38:01.020186", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141726 s, 814 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141726 s, 814 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:01.198 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7', 'scsi-35000c500871a3370', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7', 'wwn-0x5000c500871a3370'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HRN7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a3370', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7-part1', 'scsi-35000c500871a3370-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1', 'wwn-0x5000c500871a3370-part1'], 'uuids': ['a9bc468f-7d76-441a-b17b-cd059807719c'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HRN7", "scsi-35000c500871a3370", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7", "wwn-0x5000c500871a3370"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRN7-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-08-03T10:38:01.199 INFO:teuthology.task.ansible.out:Z1W4HRN7-part1", "scsi-35000c500871a3370-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HRN7-part1", "wwn-0x5000c500871a3370-part1"], "labels": [], "masters": [], "uuids": ["a9bc468f-7d76-441a-b17b-cd059807719c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRN7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a3370"}}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:01.283 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-08-03T10:38:01.285 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-08-03T10:38:01.306 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.481) 0:04:44.093 ******** 2021-08-03T10:38:01.521 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-03T10:38:01.522 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGE6tf9ahKGcGUA6XqUbzXKnsRMPdD3Skx'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.141790", "end": "2021-08-03 10:38:01.490346", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-TJJxVE5oCZcTQOq7OF9owuwMWr2rpWyGE6tf9ahKGcGUA6XqUbzXKnsRMPdD3Skx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-03 10:38:01.348556", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139073 s, 829 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139073 s, 829 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:01.564 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.258) 0:04:44.351 ******** 2021-08-03T10:38:01.608 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-08-03T10:38:01.609 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "886", "ExecMainStartTimestamp": "Tue 2021-08-03 10:33:03 UTC", "ExecMainStartTimestampMonotonic": "12666830", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSI 2021-08-03T10:38:01.611 INFO:teuthology.task.ansible.out:ZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127245", "LimitNPROCSoft": "127245", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127245", "LimitSIGPENDINGSoft": "127245", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "886", "MemoryAccounting": "yes", "MemoryCurrent": "1822720", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203592", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Tue 2021-08-03 1 2021-08-03T10:38:01.612 INFO:teuthology.task.ansible.out:0:33:03 UTC", "WatchdogTimestampMonotonic": "12666863", "WatchdogUSec": "0"}} 2021-08-03T10:38:01.636 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.071) 0:04:44.423 ******** 2021-08-03T10:38:01.663 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:38:01.665 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-08-03T10:38:01.687 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.051) 0:04:44.475 ******** 2021-08-03T10:38:01.716 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:38:01.718 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-08-03T10:38:01.740 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.052) 0:04:44.528 ******** 2021-08-03T10:38:01.769 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-08-03T10:38:01.771 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:01.794 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.053) 0:04:44.582 ******** 2021-08-03T10:38:01.823 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-08-03T10:38:01.824 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:01.847 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.052) 0:04:44.634 ******** 2021-08-03T10:38:01.859 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-08-03T10:38:01.859 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.077721", "end": "2021-08-03 10:38:01.810412", "rc": 0, "start": "2021-08-03 10:38:01.732691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:01.885 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.037) 0:04:44.672 ******** 2021-08-03T10:38:01.893 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-08-03T10:38:01.895 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:01.920 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:01 +0000 (0:00:00.034) 0:04:44.707 ******** 2021-08-03T10:38:02.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-08-03T10:38:02.117 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049541", "end": "2021-08-03 10:38:02.097634", "rc": 0, "start": "2021-08-03 10:38:02.048093", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:02.139 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.219) 0:04:44.926 ******** 2021-08-03T10:38:02.159 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.020) 0:04:44.946 ******** 2021-08-03T10:38:02.165 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-08-03T10:38:02.192 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.033) 0:04:44.980 ******** 2021-08-03T10:38:02.219 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-08-03T10:38:02.220 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.244 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.051) 0:04:45.031 ******** 2021-08-03T10:38:02.271 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-08-03T10:38:02.273 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.294 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.049) 0:04:45.081 ******** 2021-08-03T10:38:02.321 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.345 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.051) 0:04:45.133 ******** 2021-08-03T10:38:02.372 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-08-03T10:38:02.374 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.394 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.048) 0:04:45.182 ******** 2021-08-03T10:38:02.587 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-08-03T10:38:02.589 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-03T10:38:02.615 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.221) 0:04:45.403 ******** 2021-08-03T10:38:02.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-08-03T10:38:02.625 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-08-03T10:38:02.648 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.032) 0:04:45.436 ******** 2021-08-03T10:38:02.657 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-08-03T10:38:02.659 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930250903552, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227112037, 'block_used': 12983071, 'inode_total': 61054976, 'inode_available': 60985739, 'inode_used': 69237, 'uuid': 'a9bc468f-7d76-441a-b17b-cd059807719c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227112037, "block_size": 4096, "block_total": 240095108, "block_used": 12983071, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985739, "inode_total": 61054976, "inode_used": 69237, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930250903552, "size_total": 983429562368, "uuid": "a9bc468f-7d76-441a-b17b-cd059807719c"}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.682 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.034) 0:04:45.470 ******** 2021-08-03T10:38:02.710 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-08-03T10:38:02.712 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.733 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.050) 0:04:45.521 ******** 2021-08-03T10:38:02.761 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.783 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.050) 0:04:45.571 ******** 2021-08-03T10:38:02.811 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:38:02.812 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.833 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.049) 0:04:45.620 ******** 2021-08-03T10:38:02.860 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.882 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.049) 0:04:45.669 ******** 2021-08-03T10:38:02.909 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-08-03T10:38:02.911 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.931 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.049) 0:04:45.719 ******** 2021-08-03T10:38:02.959 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-08-03T10:38:02.960 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:02.981 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:02 +0000 (0:00:00.049) 0:04:45.769 ******** 2021-08-03T10:38:03.435 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-08-03T10:38:03.438 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-08-03T10:38:03.458 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:03 +0000 (0:00:00.477) 0:04:46.246 ******** 2021-08-03T10:38:03.819 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-08-03T10:38:03.821 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-08-03T10:38:03.843 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:03 +0000 (0:00:00.384) 0:04:46.630 ******** 2021-08-03T10:38:03.851 INFO:teuthology.task.ansible.out: 2021-08-03T10:38:03.853 INFO:teuthology.task.ansible.out:TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:38:03.864 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-08-03T10:38:03.864 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:03.885 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:03 +0000 (0:00:00.042) 0:04:46.672 ******** 2021-08-03T10:38:03.912 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-08-03T10:38:03.937 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:03 +0000 (0:00:00.052) 0:04:46.725 ******** 2021-08-03T10:38:04.111 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-08-03T10:38:04.112 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-08-03T10:38:04.133 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.195) 0:04:46.920 ******** 2021-08-03T10:38:04.160 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-08-03T10:38:04.162 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.182 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.048) 0:04:46.969 ******** 2021-08-03T10:38:04.188 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-08-03T10:38:04.190 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:38:04.210 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-08-03T10:38:04.212 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-08-03T10:38:04.232 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.050) 0:04:47.019 ******** 2021-08-03T10:38:04.258 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-08-03T10:38:04.260 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.280 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.048) 0:04:47.068 ******** 2021-08-03T10:38:04.464 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi101.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-08-03T10:38:04.486 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.205) 0:04:47.274 ******** 2021-08-03T10:38:04.535 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-08-03T10:38:04.536 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:38:04.672 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-08-03T10:38:04.674 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-08-03T10:38:04.695 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.208) 0:04:47.482 ******** 2021-08-03T10:38:04.722 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-08-03T10:38:04.724 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.744 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.048) 0:04:47.531 ******** 2021-08-03T10:38:04.771 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-08-03T10:38:04.773 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.782 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.784 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.794 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.817 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.073) 0:04:47.605 ******** 2021-08-03T10:38:04.855 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-08-03T10:38:04.857 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.867 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.869 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi101.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.892 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.074) 0:04:47.679 ******** 2021-08-03T10:38:04.898 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-08-03T10:38:04.899 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:38:04.910 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:38:04.912 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.934 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.042) 0:04:47.722 ******** 2021-08-03T10:38:04.961 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:04.984 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:04 +0000 (0:00:00.049) 0:04:47.771 ******** 2021-08-03T10:38:05.010 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-08-03T10:38:05.012 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:05.035 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.051) 0:04:47.823 ******** 2021-08-03T10:38:05.062 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-08-03T10:38:05.063 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:05.084 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.049) 0:04:47.872 ******** 2021-08-03T10:38:05.110 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-08-03T10:38:05.112 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:05.134 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.049) 0:04:47.921 ******** 2021-08-03T10:38:05.171 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-08-03T10:38:05.172 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:05.198 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.063) 0:04:47.985 ******** 2021-08-03T10:38:05.225 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-08-03T10:38:05.226 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:05.249 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.051) 0:04:48.037 ******** 2021-08-03T10:38:05.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-08-03T10:38:05.258 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-03T10:38:05.281 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.031) 0:04:48.069 ******** 2021-08-03T10:38:05.287 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-08-03T10:38:05.289 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:05.311 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.030) 0:04:48.099 ******** 2021-08-03T10:38:05.473 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-08-03T10:38:05.475 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-08-03T10:38:05.498 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:05 +0000 (0:00:00.186) 0:04:48.286 ******** 2021-08-03T10:38:05.519 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-08-03T10:38:05.521 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004845", "end": "2021-08-03 10:38:05.486434", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-08-03 10:38:05.481589", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:05.686 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002937", "end": "2021-08-03 10:38:05.657697", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-08-03 10:38:05.654760", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:05.718 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-08-03T10:38:05.720 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-03T10:38:05.855 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi101.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002852", "end": "2021-08-03 10:38:05.825695", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-08-03 10:38:05.822843", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:05.898 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-08-03T10:38:05.900 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-03T10:38:06.024 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-08-03T10:38:06.026 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003234", "end": "2021-08-03 10:38:05.992705", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-08-03 10:38:05.989471", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:06.050 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.551) 0:04:48.837 ******** 2021-08-03T10:38:06.077 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-08-03T10:38:06.079 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-08-03T10:38:06.101 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.051) 0:04:48.889 ******** 2021-08-03T10:38:06.130 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-08-03T10:38:06.132 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:06.245 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-08-03T10:38:06.247 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-03T10:38:06.257 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:06.280 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.178) 0:04:49.068 ******** 2021-08-03T10:38:06.308 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-08-03T10:38:06.309 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:06.330 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.049) 0:04:49.117 ******** 2021-08-03T10:38:06.358 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-08-03T10:38:06.360 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:06.380 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.050) 0:04:49.168 ******** 2021-08-03T10:38:06.585 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-08-03T10:38:06.587 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:38:06.608 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.227) 0:04:49.395 ******** 2021-08-03T10:38:06.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-08-03T10:38:06.648 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-08-03T10:38:06.672 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.064) 0:04:49.459 ******** 2021-08-03T10:38:06.961 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-08-03T10:38:06.963 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true} 2021-08-03T10:38:06.982 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:06 +0000 (0:00:00.310) 0:04:49.770 ******** 2021-08-03T10:38:07.299 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-08-03T10:38:07.301 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-08-03T10:38:07.321 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.339) 0:04:50.109 ******** 2021-08-03T10:38:07.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-08-03T10:38:07.349 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.370 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.157 ******** 2021-08-03T10:38:07.396 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-08-03T10:38:07.398 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.419 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.049) 0:04:50.206 ******** 2021-08-03T10:38:07.446 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-08-03T10:38:07.448 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.468 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.049) 0:04:50.256 ******** 2021-08-03T10:38:07.495 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-08-03T10:38:07.497 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.518 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.049) 0:04:50.305 ******** 2021-08-03T10:38:07.545 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-08-03T10:38:07.547 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.567 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.354 ******** 2021-08-03T10:38:07.593 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-08-03T10:38:07.595 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.616 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.049) 0:04:50.403 ******** 2021-08-03T10:38:07.643 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.665 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.049) 0:04:50.453 ******** 2021-08-03T10:38:07.692 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-08-03T10:38:07.694 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.714 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.502 ******** 2021-08-03T10:38:07.741 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-08-03T10:38:07.743 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.762 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.550 ******** 2021-08-03T10:38:07.789 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.811 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.599 ******** 2021-08-03T10:38:07.838 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-08-03T10:38:07.840 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.860 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.648 ******** 2021-08-03T10:38:07.886 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-08-03T10:38:07.888 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.908 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.696 ******** 2021-08-03T10:38:07.935 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-08-03T10:38:07.937 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:07.956 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:07 +0000 (0:00:00.048) 0:04:50.744 ******** 2021-08-03T10:38:07.983 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-08-03T10:38:07.985 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:08.005 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:08 +0000 (0:00:00.048) 0:04:50.793 ******** 2021-08-03T10:38:08.032 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-08-03T10:38:08.034 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:08.053 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:08 +0000 (0:00:00.048) 0:04:50.841 ******** 2021-08-03T10:38:08.533 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-08-03T10:38:08.535 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-08-03T10:38:08.558 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:08 +0000 (0:00:00.505) 0:04:51.346 ******** 2021-08-03T10:38:08.869 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-08-03T10:38:08.871 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "802", "ExecMainStartTimestamp": "Tue 2021-08-03 10:32:50 UTC", "ExecMainStartTimestampMonotonic": "11948124", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSI 2021-08-03T10:38:08.873 INFO:teuthology.task.ansible.out:ZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127270", "LimitNPROCSoft": "127270", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127270", "LimitSIGPENDINGSoft": "127270", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "802", "MemoryAccounting": "yes", "MemoryCurrent": "2138112", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203632", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Tue 2021-08-03 1 2021-08-03T10:38:08.874 INFO:teuthology.task.ansible.out:0:32:50 UTC", "WatchdogTimestampMonotonic": "11948169", "WatchdogUSec": "0"}} 2021-08-03T10:38:08.892 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:08 +0000 (0:00:00.333) 0:04:51.679 ******** 2021-08-03T10:38:08.918 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:38:08.920 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-08-03T10:38:08.940 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:08 +0000 (0:00:00.047) 0:04:51.727 ******** 2021-08-03T10:38:08.976 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:38:08.978 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-08-03T10:38:08.997 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:08 +0000 (0:00:00.057) 0:04:51.785 ******** 2021-08-03T10:38:09.023 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-08-03T10:38:09.025 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:09.044 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:09 +0000 (0:00:00.046) 0:04:51.831 ******** 2021-08-03T10:38:09.070 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-08-03T10:38:09.072 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:09.091 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:09 +0000 (0:00:00.047) 0:04:51.879 ******** 2021-08-03T10:38:09.118 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-08-03T10:38:09.120 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:09.141 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:09 +0000 (0:00:00.049) 0:04:51.928 ******** 2021-08-03T10:38:09.344 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-08-03T10:38:09.389 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} Tuesday 03 August 2021 10:38:09 +0000 (0:00:00.226) 0:04:52.155 ******** 2021-08-03T10:38:09.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-08-03T10:38:09.852 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-08-03T10:38:09.872 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:09 +0000 (0:00:00.504) 0:04:52.660 ******** 2021-08-03T10:38:10.929 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-08-03T10:38:10.931 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-08-03T10:38:10.951 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:10 +0000 (0:00:01.078) 0:04:53.739 ******** 2021-08-03T10:38:10.988 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-08-03T10:38:10.990 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:11.012 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.061) 0:04:53.800 ******** 2021-08-03T10:38:11.050 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-08-03T10:38:11.052 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-08-03T10:38:11.071 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.058) 0:04:53.859 ******** 2021-08-03T10:38:11.263 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-08-03T10:38:11.265 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-08-03T10:38:11.286 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.214) 0:04:54.073 ******** 2021-08-03T10:38:11.313 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-08-03T10:38:11.315 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:11.335 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.049) 0:04:54.123 ******** 2021-08-03T10:38:11.372 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-08-03T10:38:11.374 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-08-03T10:38:11.394 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.058) 0:04:54.181 ******** 2021-08-03T10:38:11.421 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-08-03T10:38:11.422 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:11.442 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.048) 0:04:54.230 ******** 2021-08-03T10:38:11.636 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-08-03T10:38:11.637 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-08-03T10:38:11.657 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.214) 0:04:54.445 ******** 2021-08-03T10:38:11.850 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-08-03T10:38:11.852 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-08-03T10:38:11.872 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.214) 0:04:54.659 ******** 2021-08-03T10:38:11.898 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-08-03T10:38:11.900 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:11.920 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.048) 0:04:54.707 ******** 2021-08-03T10:38:11.957 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-08-03T10:38:11.959 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-08-03T10:38:11.969 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-08-03T10:38:11.970 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-08-03T10:38:11.993 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:11 +0000 (0:00:00.072) 0:04:54.780 ******** 2021-08-03T10:38:12.030 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-08-03T10:38:12.032 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.042 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.042 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.053 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.076 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.083) 0:04:54.864 ******** 2021-08-03T10:38:12.103 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-03T10:38:12.105 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.127 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.050) 0:04:54.914 ******** 2021-08-03T10:38:12.153 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-08-03T10:38:12.155 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.176 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.049) 0:04:54.963 ******** 2021-08-03T10:38:12.203 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.227 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.050) 0:04:55.014 ******** 2021-08-03T10:38:12.254 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-08-03T10:38:12.256 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.276 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.049) 0:04:55.064 ******** 2021-08-03T10:38:12.303 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-08-03T10:38:12.305 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.326 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.049) 0:04:55.114 ******** 2021-08-03T10:38:12.353 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-08-03T10:38:12.355 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.376 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.049) 0:04:55.164 ******** 2021-08-03T10:38:12.402 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-08-03T10:38:12.404 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.429 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.052) 0:04:55.216 ******** 2021-08-03T10:38:12.455 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-08-03T10:38:12.457 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:12.476 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:12 +0000 (0:00:00.047) 0:04:55.263 ******** 2021-08-03T10:38:12.700 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-08-03T10:38:12.702 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005625", "end": "2021-08-03 10:38:12.663173", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-08-03 10:38:12.657548", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:12.866 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003214", "end": "2021-08-03 10:38:12.841682", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-08-03 10:38:12.838468", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:13.043 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002955", "end": "2021-08-03 10:38:13.014734", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-08-03 10:38:13.011779", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:13.219 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003347", "end": "2021-08-03 10:38:13.189337", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-08-03 10:38:13.185990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:13.242 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:13 +0000 (0:00:00.765) 0:04:56.029 ******** 2021-08-03T10:38:13.268 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-08-03T10:38:13.290 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:13 +0000 (0:00:00.048) 0:04:56.078 ******** 2021-08-03T10:38:13.316 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-08-03T10:38:13.318 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:13.382 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-08-03T10:38:13.400 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:13 +0000 (0:00:00.109) 0:04:56.187 ******** 2021-08-03T10:38:13.420 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:13 +0000 (0:00:00.019) 0:04:56.207 ******** 2021-08-03T10:38:14.059 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi003.front.sepia.ceph.com] 2021-08-03T10:38:14.067 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] 2021-08-03T10:38:14.120 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.700) 0:04:56.907 ******** 2021-08-03T10:38:14.139 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.019) 0:04:56.927 ******** 2021-08-03T10:38:14.145 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-03T10:38:14.147 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:14.168 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.029) 0:04:56.956 ******** 2021-08-03T10:38:14.175 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:14.198 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.029) 0:04:56.985 ******** 2021-08-03T10:38:14.203 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-03T10:38:14.205 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-08-03T10:38:14.227 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.029) 0:04:57.015 ******** 2021-08-03T10:38:14.234 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-08-03T10:38:14.258 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.030) 0:04:57.045 ******** 2021-08-03T10:38:14.275 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-08-03T10:38:14.276 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-08-03T10:38:14.299 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.041) 0:04:57.087 ******** 2021-08-03T10:38:14.306 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-08-03T10:38:14.331 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:14 +0000 (0:00:00.031) 0:04:57.118 ******** 2021-08-03T10:38:20.529 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-08-03T10:38:20.532 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Installed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Installed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch", "Removed: podman-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Removed: podman-catatonit-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Removed: podman-docker-2.2.1-7.module_el8.3.0+699+d61d9c41.noarch"]} 2021-08-03T10:38:20.551 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:20 +0000 (0:00:06.220) 0:05:03.339 ******** 2021-08-03T10:38:20.577 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-03T10:38:20.579 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-08-03T10:38:20.599 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:20 +0000 (0:00:00.047) 0:05:03.386 ******** 2021-08-03T10:38:20.625 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-03T10:38:20.627 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:20.646 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:20 +0000 (0:00:00.047) 0:05:03.434 ******** 2021-08-03T10:38:20.869 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-08-03T10:38:20.871 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:38:21.037 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-08-03T10:38:21.038 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Installed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Installed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch", "Removed: podman-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Removed: podman-catatonit-2.2.1-7.module_el8.3.0+699+d61d9c41.x86_64", "Removed: podman-docker-2.2.1-7.module_el8.3.0+699+d61d9c41.noarch"]} 2021-08-03T10:38:21.058 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:21 +0000 (0:00:00.412) 0:05:03.846 ******** 2021-08-03T10:38:21.066 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-08-03T10:38:21.068 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:38:21.093 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:21 +0000 (0:00:00.034) 0:05:03.881 ******** 2021-08-03T10:38:21.100 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-03T10:38:21.102 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-08-03T10:38:21.125 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:21 +0000 (0:00:00.031) 0:05:03.913 ******** 2021-08-03T10:38:21.153 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-03T10:38:21.154 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:21.174 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:21 +0000 (0:00:00.049) 0:05:03.962 ******** 2021-08-03T10:38:21.411 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-08-03T10:38:21.413 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:38:21.588 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-03T10:38:21.612 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:21 +0000 (0:00:00.437) 0:05:04.399 ******** 2021-08-03T10:38:21.619 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-08-03T10:38:21.620 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987101.1597307-25751-10956599523193/source", "state": "file", "uid": 0} 2021-08-03T10:38:22.069 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987101.636923-25751-101528823844317/source", "state": "file", "uid": 0} 2021-08-03T10:38:22.093 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:22 +0000 (0:00:00.481) 0:05:04.881 ******** 2021-08-03T10:38:22.142 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987101.679311-25806-239582352401166/source", "state": "file", "uid": 0} 2021-08-03T10:38:22.635 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627987102.1734905-25806-244084140990110/source", "state": "file", "uid": 0} 2021-08-03T10:38:22.660 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:22 +0000 (0:00:00.566) 0:05:05.447 ******** 2021-08-03T10:38:23.671 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-08-03T10:38:23.673 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:38:23.695 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:23 +0000 (0:00:01.035) 0:05:06.483 ******** 2021-08-03T10:38:24.320 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-03T10:38:24.343 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:24 +0000 (0:00:00.647) 0:05:07.131 ******** 2021-08-03T10:38:26.899 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-08-03T10:38:26.901 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-gy7s_rsk-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-gy7s_rsk-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-08-03T10:38:26.902 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-08-03T10:38:26.922 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:26 +0000 (0:00:02.579) 0:05:09.710 ******** 2021-08-03T10:38:26.950 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-08-03T10:38:26.952 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:26.975 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:26 +0000 (0:00:00.052) 0:05:09.762 ******** 2021-08-03T10:38:27.002 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-08-03T10:38:27.004 INFO:teuthology.task.ansible.out:skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:27.029 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:27 +0000 (0:00:00.054) 0:05:09.816 ******** 2021-08-03T10:38:27.378 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-08-03T10:38:27.381 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.153370", "end": "2021-08-03 10:38:27.353406", "rc": 0, "start": "2021-08-03 10:38:27.200036", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:27.400 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:27 +0000 (0:00:00.371) 0:05:10.188 ******** 2021-08-03T10:38:27.438 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* skipping: [smithi101.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:27.606 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-08-03T10:38:27.609 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-xm3_h4mu-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-xm3_h4mu-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-08-03T10:38:27.610 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-08-03T10:38:27.627 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:27 +0000 (0:00:00.226) 0:05:10.415 ******** 2021-08-03T10:38:27.655 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-08-03T10:38:27.657 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:27.676 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:27 +0000 (0:00:00.048) 0:05:10.464 ******** 2021-08-03T10:38:27.704 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-08-03T10:38:27.706 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:27.726 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:27 +0000 (0:00:00.050) 0:05:10.514 ******** 2021-08-03T10:38:28.086 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-08-03T10:38:28.088 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.160716", "end": "2021-08-03 10:38:28.060743", "rc": 0, "start": "2021-08-03 10:38:27.900027", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-03T10:38:28.108 INFO:teuthology.task.ansible.out:Tuesday 03 August 2021 10:38:28 +0000 (0:00:00.381) 0:05:10.896 ******** 2021-08-03T10:38:28.135 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-08-03T10:38:28.137 INFO:teuthology.task.ansible.out:skipping: [smithi003.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-03T10:38:28.199 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-08-03T10:38:28.200 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-08-03T10:38:28.202 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-08-03T10:38:28.205 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-08-03T10:38:28.215 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Tuesday 03 August 2021 10:38:28 +0000 (0:00:00.107) 0:05:11.003 ******** 2021-08-03T10:38:28.878 INFO:teuthology.task.ansible.out:ok: [smithi003.front.sepia.ceph.com] 2021-08-03T10:38:28.897 INFO:teuthology.task.ansible.out:ok: [smithi101.front.sepia.ceph.com] 2021-08-03T10:38:28.913 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Tuesday 03 August 2021 10:38:28 +0000 (0:00:00.697) 0:05:11.701 ******** 2021-08-03T10:38:29.115 INFO:teuthology.task.ansible.out:changed: [smithi003.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-08-03T10:38:29.127 INFO:teuthology.task.ansible.out:changed: [smithi101.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-08-03T10:38:29.129 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-08-03T10:38:29.131 INFO:teuthology.task.ansible.out:smithi003.front.sepia.ceph.com : ok=133 changed=48 unreachable=0 failed=0 skipped=187 rescued=0 ignored=3 smithi101.front.sepia.ceph.com : ok=133 changed=48 unreachable=0 failed=0 skipped=187 rescued=0 ignored=3 Tuesday 03 August 2021 10:38:29 +0000 (0:00:00.216) 0:05:11.917 ******** =============================================================================== Create all admin users with sudo access. ------------------------------- 50.74s common : nrpe - Ensure SELinux policy is up to date -------------------- 33.72s users : Update authorized_keys using the keys repo --------------------- 28.44s testnode : Ensure ceph packages are not present. ----------------------- 13.07s common : nrpe - Remove SELinux policy package -------------------------- 10.90s common : nrpe - Load SELinux policy package ---------------------------- 10.02s Remove revoked users ---------------------------------------------------- 7.08s container-host : Install container packages ----------------------------- 6.22s testnode : Ensure ceph dependency packages are not present. ------------- 2.98s container-host : Install registries-conf-ctl ---------------------------- 2.58s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.27s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.93s users : Update authorized_keys for each user with literal keys ---------- 1.72s common : nrpe - Install SELinux dependencies ---------------------------- 1.65s testnode : Install packages --------------------------------------------- 1.57s Gathering Facts --------------------------------------------------------- 1.52s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.46s testnode : Make sure rpm dependencies are installed --------------------- 1.41s common : Make sure smartmontools is installed --------------------------- 1.21s testnode : Install packages vi 2021-08-03T10:38:29.132 INFO:teuthology.task.ansible.out:a pip ------------------------------------- 1.08s 2021-08-03T10:38:29.489 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi101.front.sepia.ceph.com')] 2021-08-03T10:38:29.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-03T10:38:29.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:38:29.566 DEBUG:teuthology.orchestra.run.smithi003:> true 2021-08-03T10:38:29.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-03T10:38:29.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-03T10:38:29.719 DEBUG:teuthology.orchestra.run.smithi101:> true 2021-08-03T10:38:29.802 INFO:teuthology.run_tasks:Running task clock... 2021-08-03T10:38:29.814 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-08-03T10:38:29.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-08-03T10:38:29.817 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-08-03T10:38:29.849 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-08-03T10:38:29.864 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-08-03T10:38:29.899 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2021-08-03T10:38:29.910 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2021-08-03T10:38:29.923 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-08-03T10:38:29.937 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-08-03T10:38:30.001 INFO:teuthology.orchestra.run.smithi003.stderr:bash: ntpq: command not found 2021-08-03T10:38:30.004 INFO:teuthology.orchestra.run.smithi003.stdout:210 Number of sources = 4 2021-08-03T10:38:30.004 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-08-03T10:38:30.004 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2021-08-03T10:38:30.005 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.005 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.005 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.005 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.006 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-08-03T10:38:30.006 DEBUG:teuthology.orchestra.run.smithi101:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-08-03T10:38:30.038 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-08-03T10:38:30.052 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-08-03T10:38:30.090 INFO:teuthology.orchestra.run.smithi101.stderr:sudo: ntpd: command not found 2021-08-03T10:38:30.100 INFO:teuthology.orchestra.run.smithi101.stdout:506 Cannot talk to daemon 2021-08-03T10:38:30.114 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-08-03T10:38:30.127 INFO:teuthology.orchestra.run.smithi101.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-08-03T10:38:30.189 INFO:teuthology.orchestra.run.smithi101.stderr:bash: ntpq: command not found 2021-08-03T10:38:30.196 INFO:teuthology.orchestra.run.smithi101.stdout:210 Number of sources = 4 2021-08-03T10:38:30.196 INFO:teuthology.orchestra.run.smithi101.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-08-03T10:38:30.196 INFO:teuthology.orchestra.run.smithi101.stdout:=============================================================================== 2021-08-03T10:38:30.197 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.197 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.197 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.197 INFO:teuthology.orchestra.run.smithi101.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-03T10:38:30.198 INFO:teuthology.run_tasks:Running task install... 2021-08-03T10:38:30.207 DEBUG:teuthology.task.install:project ceph 2021-08-03T10:38:30.208 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515'}} 2021-08-03T10:38:30.208 DEBUG:teuthology.task.install:config {'debuginfo': True, 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515'} 2021-08-03T10:38:30.208 INFO:teuthology.task.install:Using flavor: basic 2021-08-03T10:38:30.214 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2021-08-03T10:38:30.215 INFO:teuthology.task.install:extra packages: [] 2021-08-03T10:38:30.216 DEBUG:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2021-08-03T10:38:30.252 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2021-08-03T10:38:30.254 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-03T10:38:30.255 DEBUG:teuthology.orchestra.run.smithi101:> sudo lsb_release -is 2021-08-03T10:38:30.256 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515', 'tag': None, 'wait_for_package': False} 2021-08-03T10:38:30.257 DEBUG:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2021-08-03T10:38:30.291 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS 2021-08-03T10:38:30.293 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-03T10:38:30.294 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515', 'tag': None, 'wait_for_package': False} 2021-08-03T10:38:30.295 DEBUG:teuthology.orchestra.run.smithi101:> sudo lsb_release -is 2021-08-03T10:38:30.329 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2021-08-03T10:38:30.331 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-03T10:38:30.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df0bf89fcfd3db43ce7267598c7265ea8975a515 2021-08-03T10:38:30.369 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS 2021-08-03T10:38:30.370 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-03T10:38:30.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df0bf89fcfd3db43ce7267598c7265ea8975a515 2021-08-03T10:38:30.495 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/ 2021-08-03T10:38:30.496 INFO:teuthology.task.install.rpm:Package version is 17.0.0-6630.gdf0bf89f 2021-08-03T10:38:30.523 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/ 2021-08-03T10:38:30.524 INFO:teuthology.task.install.rpm:Package version is 17.0.0-6630.gdf0bf89f 2021-08-03T10:38:30.629 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-08-03T10:38:30.629 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:38:30.629 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-08-03T10:38:30.642 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing2-2021-08-03-1601/df0bf89fcfd3db43ce7267598c7265ea8975a515/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-08-03T10:38:30.642 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:38:30.643 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-08-03T10:38:30.655 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2021-08-03T10:38:30.656 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/df0bf89fcfd3db43ce7267598c7265ea8975a515/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-08-03T10:38:30.666 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2021-08-03T10:38:30.667 DEBUG:teuthology.orchestra.run.smithi101:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/df0bf89fcfd3db43ce7267598c7265ea8975a515/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-08-03T10:38:30.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-08-03T10:38:30.730 DEBUG:teuthology.orchestra.run.smithi101:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-08-03T10:38:30.802 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-08-03T10:38:30.804 DEBUG:teuthology.orchestra.run.smithi101:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-08-03T10:38:30.866 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2021-08-03T10:38:30.868 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2021-08-03T10:38:30.869 INFO:teuthology.orchestra.run.smithi101.stdout:check_obsoletes = 1 2021-08-03T10:38:30.869 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum clean all 2021-08-03T10:38:31.198 INFO:teuthology.orchestra.run.smithi101.stdout:85 files removed 2021-08-03T10:38:31.214 INFO:teuthology.orchestra.run.smithi003.stdout:85 files removed 2021-08-03T10:38:31.234 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-radosgw 2021-08-03T10:38:31.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw 2021-08-03T10:38:31.901 INFO:teuthology.orchestra.run.smithi101.stdout:ceph packages for x86_64 299 kB/s | 76 kB 00:00 2021-08-03T10:38:31.950 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 296 kB/s | 76 kB 00:00 2021-08-03T10:38:32.139 INFO:teuthology.orchestra.run.smithi101.stdout:ceph noarch packages 36 kB/s | 7.3 kB 00:00 2021-08-03T10:38:32.190 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 36 kB/s | 7.3 kB 00:00 2021-08-03T10:38:32.366 INFO:teuthology.orchestra.run.smithi101.stdout:ceph source packages 7.1 kB/s | 1.5 kB 00:00 2021-08-03T10:38:32.421 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 7.0 kB/s | 1.5 kB 00:00 2021-08-03T10:38:32.615 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS-8 - AppStream 36 MB/s | 8.3 MB 00:00 2021-08-03T10:38:32.668 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - AppStream 37 MB/s | 8.3 MB 00:00 2021-08-03T10:38:34.039 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS-8 - Base 41 MB/s | 4.5 MB 00:00 2021-08-03T10:38:34.122 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Base 38 MB/s | 4.5 MB 00:00 2021-08-03T10:38:34.728 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS-8 - Extras 143 kB/s | 10 kB 00:00 2021-08-03T10:38:34.848 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - Extras 162 kB/s | 10 kB 00:00 2021-08-03T10:38:36.150 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Linux 8 - AppStream 6.0 MB/s | 8.3 MB 00:01 2021-08-03T10:38:37.588 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - AppStream 3.1 MB/s | 8.3 MB 00:02 2021-08-03T10:38:38.286 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Linux 8 - BaseOS 5.2 MB/s | 4.5 MB 00:00 2021-08-03T10:38:39.371 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS Linux 8 - Extras 22 kB/s | 10 kB 00:00 2021-08-03T10:38:39.517 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS-8 - PowerTools 25 MB/s | 2.3 MB 00:00 2021-08-03T10:38:39.821 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - BaseOS 5.2 MB/s | 4.5 MB 00:00 2021-08-03T10:38:41.004 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Linux 8 - Extras 21 kB/s | 10 kB 00:00 2021-08-03T10:38:41.153 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS-8 - PowerTools 26 MB/s | 2.3 MB 00:00 2021-08-03T10:38:42.205 INFO:teuthology.orchestra.run.smithi101.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2021-08-03T10:38:42.976 INFO:teuthology.orchestra.run.smithi101.stdout:Extra Packages for Enterprise Linux 14 MB/s | 10 MB 00:00 2021-08-03T10:38:43.866 INFO:teuthology.orchestra.run.smithi003.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2021-08-03T10:38:44.562 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 16 MB/s | 10 MB 00:00 2021-08-03T10:38:45.073 INFO:teuthology.orchestra.run.smithi101.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-08-03T10:38:46.823 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-08-03T10:38:47.181 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:38:47.199 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:38:47.200 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:38:47.200 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:38:47.200 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:38:47.201 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 8.0 M 2021-08-03T10:38:47.201 INFO:teuthology.orchestra.run.smithi101.stdout:Upgrading: 2021-08-03T10:38:47.201 INFO:teuthology.orchestra.run.smithi101.stdout: librados2 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.2 M 2021-08-03T10:38:47.201 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.7 M 2021-08-03T10:38:47.201 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:38:47.202 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 6.1 M 2021-08-03T10:38:47.202 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 20 M 2021-08-03T10:38:47.202 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-selinux x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 24 k 2021-08-03T10:38:47.202 INFO:teuthology.orchestra.run.smithi101.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-08-03T10:38:47.203 INFO:teuthology.orchestra.run.smithi101.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-08-03T10:38:47.203 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 742 k 2021-08-03T10:38:47.203 INFO:teuthology.orchestra.run.smithi101.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-08-03T10:38:47.203 INFO:teuthology.orchestra.run.smithi101.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-08-03T10:38:47.204 INFO:teuthology.orchestra.run.smithi101.stdout: libradosstriper1 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 463 k 2021-08-03T10:38:47.204 INFO:teuthology.orchestra.run.smithi101.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-08-03T10:38:47.204 INFO:teuthology.orchestra.run.smithi101.stdout: librgw2 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.3 M 2021-08-03T10:38:47.204 INFO:teuthology.orchestra.run.smithi101.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-08-03T10:38:47.204 INFO:teuthology.orchestra.run.smithi101.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-08-03T10:38:47.205 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-argparse 2021-08-03T10:38:47.205 INFO:teuthology.orchestra.run.smithi101.stdout: x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 44 k 2021-08-03T10:38:47.205 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-common x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 78 k 2021-08-03T10:38:47.205 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 178 k 2021-08-03T10:38:47.205 INFO:teuthology.orchestra.run.smithi101.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-08-03T10:38:47.206 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 365 k 2021-08-03T10:38:47.206 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 345 k 2021-08-03T10:38:47.206 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 110 k 2021-08-03T10:38:47.206 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:38:47.206 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:38:47.207 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:38:47.207 INFO:teuthology.orchestra.run.smithi101.stdout:Install 21 Packages 2021-08-03T10:38:47.207 INFO:teuthology.orchestra.run.smithi101.stdout:Upgrade 2 Packages 2021-08-03T10:38:47.207 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:38:47.208 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 48 M 2021-08-03T10:38:47.208 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:38:48.000 INFO:teuthology.orchestra.run.smithi101.stdout:(1/23): ceph-base-17.0.0-6630.gdf0bf89f.el8.x86 7.6 MB/s | 6.1 MB 00:00 2021-08-03T10:38:48.042 INFO:teuthology.orchestra.run.smithi101.stdout:(2/23): ceph-selinux-17.0.0-6630.gdf0bf89f.el8. 581 kB/s | 24 kB 00:00 2021-08-03T10:38:48.151 INFO:teuthology.orchestra.run.smithi101.stdout:(3/23): libcephfs2-17.0.0-6630.gdf0bf89f.el8.x8 6.7 MB/s | 742 kB 00:00 2021-08-03T10:38:48.186 INFO:teuthology.orchestra.run.smithi101.stdout:(4/23): ceph-radosgw-17.0.0-6630.gdf0bf89f.el8. 8.1 MB/s | 8.0 MB 00:00 2021-08-03T10:38:48.210 INFO:teuthology.orchestra.run.smithi101.stdout:(5/23): libradosstriper1-17.0.0-6630.gdf0bf89f. 7.6 MB/s | 463 kB 00:00 2021-08-03T10:38:48.261 INFO:teuthology.orchestra.run.smithi101.stdout:(6/23): python3-ceph-argparse-17.0.0-6630.gdf0b 880 kB/s | 44 kB 00:00 2021-08-03T10:38:48.313 INFO:teuthology.orchestra.run.smithi101.stdout:(7/23): python3-ceph-common-17.0.0-6630.gdf0bf8 1.5 MB/s | 78 kB 00:00 2021-08-03T10:38:48.373 INFO:teuthology.orchestra.run.smithi101.stdout:(8/23): python3-cephfs-17.0.0-6630.gdf0bf89f.el 2.9 MB/s | 178 kB 00:00 2021-08-03T10:38:48.444 INFO:teuthology.orchestra.run.smithi101.stdout:(9/23): python3-rados-17.0.0-6630.gdf0bf89f.el8 5.0 MB/s | 365 kB 00:00 2021-08-03T10:38:48.487 INFO:teuthology.orchestra.run.smithi101.stdout:(10/23): librgw2-17.0.0-6630.gdf0bf89f.el8.x86_ 11 MB/s | 3.3 MB 00:00 2021-08-03T10:38:48.494 INFO:teuthology.orchestra.run.smithi101.stdout:(11/23): python3-rbd-17.0.0-6630.gdf0bf89f.el8. 6.8 MB/s | 345 kB 00:00 2021-08-03T10:38:48.522 INFO:teuthology.orchestra.run.smithi101.stdout:(12/23): python3-rgw-17.0.0-6630.gdf0bf89f.el8. 3.0 MB/s | 110 kB 00:00 2021-08-03T10:38:48.533 INFO:teuthology.orchestra.run.smithi101.stdout:(13/23): librdkafka-0.11.4-1.el8.x86_64.rpm 8.7 MB/s | 353 kB 00:00 2021-08-03T10:38:48.535 INFO:teuthology.orchestra.run.smithi101.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 30 MB/s | 44 kB 00:00 2021-08-03T10:38:48.536 INFO:teuthology.orchestra.run.smithi101.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 36 MB/s | 47 kB 00:00 2021-08-03T10:38:48.555 INFO:teuthology.orchestra.run.smithi101.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.9 MB/s | 259 kB 00:00 2021-08-03T10:38:48.691 INFO:teuthology.orchestra.run.smithi101.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 1.3 MB/s | 181 kB 00:00 2021-08-03T10:38:48.700 INFO:teuthology.orchestra.run.smithi101.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2021-08-03T10:38:48.719 INFO:teuthology.orchestra.run.smithi101.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 2.1 MB/s | 59 kB 00:00 2021-08-03T10:38:48.729 INFO:teuthology.orchestra.run.smithi101.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 2.6 MB/s | 75 kB 00:00 2021-08-03T10:38:48.842 INFO:teuthology.orchestra.run.smithi101.stdout:(21/23): ceph-common-17.0.0-6630.gdf0bf89f.el8. 12 MB/s | 20 MB 00:01 2021-08-03T10:38:48.990 INFO:teuthology.orchestra.run.smithi101.stdout:(22/23): librbd1-17.0.0-6630.gdf0bf89f.el8.x86_ 14 MB/s | 3.7 MB 00:00 2021-08-03T10:38:49.030 INFO:teuthology.orchestra.run.smithi101.stdout:(23/23): librados2-17.0.0-6630.gdf0bf89f.el8.x8 10 MB/s | 3.2 MB 00:00 2021-08-03T10:38:49.034 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:38:49.035 INFO:teuthology.orchestra.run.smithi101.stdout:Total 26 MB/s | 48 MB 00:01 2021-08-03T10:38:49.038 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:38:49.048 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:38:49.074 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:38:49.074 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:38:49.074 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:38:49.075 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:38:49.075 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 8.0 M 2021-08-03T10:38:49.075 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2021-08-03T10:38:49.075 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.2 M 2021-08-03T10:38:49.076 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.7 M 2021-08-03T10:38:49.076 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:38:49.076 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 6.1 M 2021-08-03T10:38:49.076 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 20 M 2021-08-03T10:38:49.077 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 24 k 2021-08-03T10:38:49.077 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-08-03T10:38:49.077 INFO:teuthology.orchestra.run.smithi003.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-08-03T10:38:49.077 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 742 k 2021-08-03T10:38:49.077 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-08-03T10:38:49.078 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-08-03T10:38:49.078 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 463 k 2021-08-03T10:38:49.078 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-08-03T10:38:49.078 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.3 M 2021-08-03T10:38:49.079 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-08-03T10:38:49.079 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-08-03T10:38:49.079 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse 2021-08-03T10:38:49.079 INFO:teuthology.orchestra.run.smithi003.stdout: x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 44 k 2021-08-03T10:38:49.080 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 78 k 2021-08-03T10:38:49.080 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 178 k 2021-08-03T10:38:49.080 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-08-03T10:38:49.080 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 365 k 2021-08-03T10:38:49.081 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 345 k 2021-08-03T10:38:49.081 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 110 k 2021-08-03T10:38:49.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:38:49.081 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:38:49.081 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:38:49.082 INFO:teuthology.orchestra.run.smithi003.stdout:Install 21 Packages 2021-08-03T10:38:49.082 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 2 Packages 2021-08-03T10:38:49.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:38:49.083 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:38:49.084 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:38:49.084 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 48 M 2021-08-03T10:38:49.084 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:38:49.393 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:38:49.396 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:38:50.030 INFO:teuthology.orchestra.run.smithi003.stdout:(1/23): ceph-radosgw-17.0.0-6630.gdf0bf89f.el8. 8.4 MB/s | 8.0 MB 00:00 2021-08-03T10:38:50.047 INFO:teuthology.orchestra.run.smithi003.stdout:(2/23): ceph-base-17.0.0-6630.gdf0bf89f.el8.x86 6.3 MB/s | 6.1 MB 00:00 2021-08-03T10:38:50.065 INFO:teuthology.orchestra.run.smithi003.stdout:(3/23): ceph-selinux-17.0.0-6630.gdf0bf89f.el8. 687 kB/s | 24 kB 00:00 2021-08-03T10:38:50.139 INFO:teuthology.orchestra.run.smithi003.stdout:(4/23): libradosstriper1-17.0.0-6630.gdf0bf89f. 6.1 MB/s | 463 kB 00:00 2021-08-03T10:38:50.151 INFO:teuthology.orchestra.run.smithi003.stdout:(5/23): libcephfs2-17.0.0-6630.gdf0bf89f.el8.x8 7.0 MB/s | 742 kB 00:00 2021-08-03T10:38:50.218 INFO:teuthology.orchestra.run.smithi003.stdout:(6/23): python3-ceph-argparse-17.0.0-6630.gdf0b 659 kB/s | 44 kB 00:00 2021-08-03T10:38:50.291 INFO:teuthology.orchestra.run.smithi003.stdout:(7/23): python3-ceph-common-17.0.0-6630.gdf0bf8 1.0 MB/s | 78 kB 00:00 2021-08-03T10:38:50.376 INFO:teuthology.orchestra.run.smithi003.stdout:(8/23): python3-cephfs-17.0.0-6630.gdf0bf89f.el 2.1 MB/s | 178 kB 00:00 2021-08-03T10:38:50.428 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:38:50.433 INFO:teuthology.orchestra.run.smithi003.stdout:(9/23): librgw2-17.0.0-6630.gdf0bf89f.el8.x86_6 11 MB/s | 3.3 MB 00:00 2021-08-03T10:38:50.454 INFO:teuthology.orchestra.run.smithi003.stdout:(10/23): python3-rados-17.0.0-6630.gdf0bf89f.el 4.6 MB/s | 365 kB 00:00 2021-08-03T10:38:50.501 INFO:teuthology.orchestra.run.smithi003.stdout:(11/23): python3-rbd-17.0.0-6630.gdf0bf89f.el8. 5.0 MB/s | 345 kB 00:00 2021-08-03T10:38:50.509 INFO:teuthology.orchestra.run.smithi003.stdout:(12/23): python3-rgw-17.0.0-6630.gdf0bf89f.el8. 2.0 MB/s | 110 kB 00:00 2021-08-03T10:38:50.535 INFO:teuthology.orchestra.run.smithi003.stdout:(13/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2021-08-03T10:38:50.538 INFO:teuthology.orchestra.run.smithi003.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 27 MB/s | 44 kB 00:00 2021-08-03T10:38:50.540 INFO:teuthology.orchestra.run.smithi003.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 24 MB/s | 47 kB 00:00 2021-08-03T10:38:50.543 INFO:teuthology.orchestra.run.smithi003.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.3 MB/s | 259 kB 00:00 2021-08-03T10:38:50.638 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-08-03T10:38:50.726 INFO:teuthology.orchestra.run.smithi003.stdout:(17/23): ceph-common-17.0.0-6630.gdf0bf89f.el8. 12 MB/s | 20 MB 00:01 2021-08-03T10:38:50.772 INFO:teuthology.orchestra.run.smithi003.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 793 kB/s | 181 kB 00:00 2021-08-03T10:38:50.774 INFO:teuthology.orchestra.run.smithi003.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2021-08-03T10:38:50.792 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-08-03T10:38:50.795 INFO:teuthology.orchestra.run.smithi003.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 3.2 MB/s | 75 kB 00:00 2021-08-03T10:38:50.838 INFO:teuthology.orchestra.run.smithi003.stdout:(21/23): liboath-2.6.2-3.el8.x86_64.rpm 525 kB/s | 59 kB 00:00 2021-08-03T10:38:50.985 INFO:teuthology.orchestra.run.smithi003.stdout:(22/23): librbd1-17.0.0-6630.gdf0bf89f.el8.x86_ 20 MB/s | 3.7 MB 00:00 2021-08-03T10:38:51.046 INFO:teuthology.orchestra.run.smithi003.stdout:(23/23): librados2-17.0.0-6630.gdf0bf89f.el8.x8 12 MB/s | 3.2 MB 00:00 2021-08-03T10:38:51.051 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:38:51.051 INFO:teuthology.orchestra.run.smithi003.stdout:Total 24 MB/s | 48 MB 00:01 2021-08-03T10:38:51.055 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:38:51.105 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:38:51.106 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:38:51.181 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-08-03T10:38:51.392 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/25 2021-08-03T10:38:51.446 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:38:51.450 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:38:51.494 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/25 2021-08-03T10:38:51.998 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 4/25 2021-08-03T10:38:52.208 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/25 2021-08-03T10:38:52.494 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:38:52.648 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/25 2021-08-03T10:38:52.740 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-08-03T10:38:52.800 INFO:teuthology.orchestra.run.smithi101.stdout: Upgrading : librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/25 2021-08-03T10:38:52.874 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/25 2021-08-03T10:38:52.899 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-08-03T10:38:53.024 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-08-03T10:38:53.201 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-08-03T10:38:53.316 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-08-03T10:38:53.483 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/25 2021-08-03T10:38:53.581 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/25 2021-08-03T10:38:53.582 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-08-03T10:38:53.725 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 9/25 2021-08-03T10:38:53.796 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 9/25 2021-08-03T10:38:53.852 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 4/25 2021-08-03T10:38:53.973 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-08-03T10:38:54.041 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/25 2021-08-03T10:38:54.088 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-ceph-argparse-2:17.0.0-6630.gdf0bf89f.el8. 11/25 2021-08-03T10:38:54.262 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 12/25 2021-08-03T10:38:54.468 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 13/25 2021-08-03T10:38:54.502 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/25 2021-08-03T10:38:54.652 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 14/25 2021-08-03T10:38:54.682 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/25 2021-08-03T10:38:54.735 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/25 2021-08-03T10:38:54.833 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_6 15/25 2021-08-03T10:38:54.900 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_6 15/25 2021-08-03T10:38:54.944 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-08-03T10:38:55.109 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-08-03T10:38:55.116 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-08-03T10:38:55.258 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-08-03T10:38:55.421 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-08-03T10:38:55.526 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-08-03T10:38:55.584 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x8 19/25 2021-08-03T10:38:55.690 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 9/25 2021-08-03T10:38:55.767 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 9/25 2021-08-03T10:38:55.898 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-08-03T10:38:56.075 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:17.0.0-6630.gdf0bf89f.el8. 11/25 2021-08-03T10:38:56.254 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 12/25 2021-08-03T10:38:56.428 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 13/25 2021-08-03T10:38:56.647 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 14/25 2021-08-03T10:38:56.816 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_6 15/25 2021-08-03T10:38:56.889 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_6 15/25 2021-08-03T10:38:57.080 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-08-03T10:38:57.252 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-08-03T10:38:57.573 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-08-03T10:38:57.758 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x8 19/25 2021-08-03T10:38:59.901 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 20/25 2021-08-03T10:39:00.099 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 20/25 2021-08-03T10:39:00.794 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 20/25 2021-08-03T10:39:01.054 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 21/25 2021-08-03T10:39:01.166 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 21/25 2021-08-03T10:39:01.282 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 22/25 2021-08-03T10:39:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 20/25 2021-08-03T10:39:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 20/25 2021-08-03T10:39:03.899 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 20/25 2021-08-03T10:39:04.139 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 21/25 2021-08-03T10:39:04.233 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 21/25 2021-08-03T10:39:04.339 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 22/25 2021-08-03T10:39:16.592 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 22/25 2021-08-03T10:39:16.593 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /sys 2021-08-03T10:39:16.593 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /proc 2021-08-03T10:39:16.593 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /dev 2021-08-03T10:39:16.594 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /run 2021-08-03T10:39:16.595 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /mnt 2021-08-03T10:39:16.595 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /var/tmp 2021-08-03T10:39:16.595 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /home 2021-08-03T10:39:16.595 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /tmp 2021-08-03T10:39:16.596 INFO:teuthology.orchestra.run.smithi101.stdout:skipping the directory /dev 2021-08-03T10:39:16.596 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:17.685 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 23/25 2021-08-03T10:39:17.758 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 23/25 2021-08-03T10:39:17.759 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-08-03T10:39:17.957 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-08-03T10:39:17.958 INFO:teuthology.orchestra.run.smithi101.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-08-03T10:39:18.849 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-08-03T10:39:18.849 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/25 2021-08-03T10:39:18.850 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/25 2021-08-03T10:39:18.850 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/25 2021-08-03T10:39:18.850 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 4/25 2021-08-03T10:39:18.850 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/25 2021-08-03T10:39:18.850 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_6 6/25 2021-08-03T10:39:18.851 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 7/25 2021-08-03T10:39:18.851 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-ceph-argparse-2:17.0.0-6630.gdf0bf89f.el8. 8/25 2021-08-03T10:39:18.851 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x8 9/25 2021-08-03T10:39:18.851 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 10/25 2021-08-03T10:39:18.852 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 11/25 2021-08-03T10:39:18.852 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 12/25 2021-08-03T10:39:18.852 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 13/25 2021-08-03T10:39:18.852 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-08-03T10:39:18.852 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-08-03T10:39:18.853 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-08-03T10:39:18.853 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-08-03T10:39:18.853 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-08-03T10:39:18.853 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-08-03T10:39:18.853 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-08-03T10:39:18.853 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-08-03T10:39:18.854 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 22/25 2021-08-03T10:39:18.854 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-08-03T10:39:18.854 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 24/25 2021-08-03T10:39:19.683 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-08-03T10:39:19.683 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:39:20.008 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:20.008 INFO:teuthology.orchestra.run.smithi101.stdout:Upgraded: 2021-08-03T10:39:20.009 INFO:teuthology.orchestra.run.smithi101.stdout: librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.009 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.009 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:20.009 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:39:20.009 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.010 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.010 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.010 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.010 INFO:teuthology.orchestra.run.smithi101.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-08-03T10:39:20.011 INFO:teuthology.orchestra.run.smithi101.stdout: leveldb-1.22-1.el8.x86_64 2021-08-03T10:39:20.011 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.011 INFO:teuthology.orchestra.run.smithi101.stdout: liboath-2.6.2-3.el8.x86_64 2021-08-03T10:39:20.011 INFO:teuthology.orchestra.run.smithi101.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-08-03T10:39:20.011 INFO:teuthology.orchestra.run.smithi101.stdout: libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.012 INFO:teuthology.orchestra.run.smithi101.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-08-03T10:39:20.012 INFO:teuthology.orchestra.run.smithi101.stdout: librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.012 INFO:teuthology.orchestra.run.smithi101.stdout: libunwind-1.3.1-3.el8.x86_64 2021-08-03T10:39:20.012 INFO:teuthology.orchestra.run.smithi101.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-08-03T10:39:20.012 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-argparse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.013 INFO:teuthology.orchestra.run.smithi101.stdout: python3-ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.013 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.013 INFO:teuthology.orchestra.run.smithi101.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-08-03T10:39:20.013 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.014 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.014 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:20.014 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:20.014 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:39:20.206 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-test 2021-08-03T10:39:20.393 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 22/25 2021-08-03T10:39:20.393 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2021-08-03T10:39:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2021-08-03T10:39:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /dev 2021-08-03T10:39:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /run 2021-08-03T10:39:20.394 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2021-08-03T10:39:20.395 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2021-08-03T10:39:20.395 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2021-08-03T10:39:20.395 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2021-08-03T10:39:20.395 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /dev 2021-08-03T10:39:20.396 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:20.742 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:00:35 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:39:21.511 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 23/25 2021-08-03T10:39:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 23/25 2021-08-03T10:39:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-08-03T10:39:21.670 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:39:21.671 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:39:21.671 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:39:21.671 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:39:21.672 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:39:21.672 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 47 M 2021-08-03T10:39:21.672 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:39:21.672 INFO:teuthology.orchestra.run.smithi101.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-08-03T10:39:21.673 INFO:teuthology.orchestra.run.smithi101.stdout: libcephsqlite x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 164 k 2021-08-03T10:39:21.673 INFO:teuthology.orchestra.run.smithi101.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-08-03T10:39:21.673 INFO:teuthology.orchestra.run.smithi101.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-08-03T10:39:21.673 INFO:teuthology.orchestra.run.smithi101.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-08-03T10:39:21.673 INFO:teuthology.orchestra.run.smithi101.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-08-03T10:39:21.674 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:21.674 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:39:21.674 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:39:21.674 INFO:teuthology.orchestra.run.smithi101.stdout:Install 7 Packages 2021-08-03T10:39:21.675 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:21.675 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 48 M 2021-08-03T10:39:21.676 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 255 M 2021-08-03T10:39:21.676 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:39:21.708 INFO:teuthology.orchestra.run.smithi101.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 4.6 MB/s | 161 kB 00:00 2021-08-03T10:39:21.711 INFO:teuthology.orchestra.run.smithi101.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 66 MB/s | 187 kB 00:00 2021-08-03T10:39:21.715 INFO:teuthology.orchestra.run.smithi101.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 73 MB/s | 302 kB 00:00 2021-08-03T10:39:21.719 INFO:teuthology.orchestra.run.smithi101.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 66 MB/s | 250 kB 00:00 2021-08-03T10:39:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-08-03T10:39:21.798 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-08-03T10:39:21.829 INFO:teuthology.orchestra.run.smithi101.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 626 kB/s | 69 kB 00:00 2021-08-03T10:39:22.199 INFO:teuthology.orchestra.run.smithi101.stdout:(6/7): libcephsqlite-17.0.0-6630.gdf0bf89f.el8. 313 kB/s | 164 kB 00:00 2021-08-03T10:39:22.501 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-08-03T10:39:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/25 2021-08-03T10:39:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/25 2021-08-03T10:39:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/25 2021-08-03T10:39:22.502 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 4/25 2021-08-03T10:39:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/25 2021-08-03T10:39:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_6 6/25 2021-08-03T10:39:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 7/25 2021-08-03T10:39:22.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:17.0.0-6630.gdf0bf89f.el8. 8/25 2021-08-03T10:39:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x8 9/25 2021-08-03T10:39:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 10/25 2021-08-03T10:39:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 11/25 2021-08-03T10:39:22.504 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 12/25 2021-08-03T10:39:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 13/25 2021-08-03T10:39:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-08-03T10:39:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-08-03T10:39:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-08-03T10:39:22.505 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-08-03T10:39:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-08-03T10:39:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-08-03T10:39:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-08-03T10:39:22.506 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-08-03T10:39:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 22/25 2021-08-03T10:39:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-08-03T10:39:22.507 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 24/25 2021-08-03T10:39:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-08-03T10:39:23.444 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:39:23.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:23.750 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2021-08-03T10:39:23.750 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.750 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:23.751 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:39:23.751 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.751 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.751 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.752 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.752 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-08-03T10:39:23.752 INFO:teuthology.orchestra.run.smithi003.stdout: leveldb-1.22-1.el8.x86_64 2021-08-03T10:39:23.752 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.753 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.2-3.el8.x86_64 2021-08-03T10:39:23.753 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-08-03T10:39:23.753 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.754 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-08-03T10:39:23.754 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.754 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.3.1-3.el8.x86_64 2021-08-03T10:39:23.754 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-08-03T10:39:23.755 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.755 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.755 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.755 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-08-03T10:39:23.755 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.756 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.756 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:23.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:23.756 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:39:23.846 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-test 2021-08-03T10:39:24.415 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:38 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:39:24.937 INFO:teuthology.orchestra.run.smithi101.stdout:(7/7): ceph-test-17.0.0-6630.gdf0bf89f.el8.x86_ 14 MB/s | 47 MB 00:03 2021-08-03T10:39:24.941 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:39:24.941 INFO:teuthology.orchestra.run.smithi101.stdout:Total 15 MB/s | 48 MB 00:03 2021-08-03T10:39:24.945 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:39:24.968 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:39:24.968 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:39:25.236 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:39:25.239 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:39:25.377 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:39:25.378 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:39:25.378 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:39:25.378 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:39:25.379 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:39:25.379 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 47 M 2021-08-03T10:39:25.379 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:39:25.379 INFO:teuthology.orchestra.run.smithi003.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-08-03T10:39:25.380 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 164 k 2021-08-03T10:39:25.380 INFO:teuthology.orchestra.run.smithi003.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-08-03T10:39:25.380 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-08-03T10:39:25.380 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-08-03T10:39:25.381 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-08-03T10:39:25.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:25.382 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:39:25.382 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:39:25.382 INFO:teuthology.orchestra.run.smithi003.stdout:Install 7 Packages 2021-08-03T10:39:25.383 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:25.383 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 48 M 2021-08-03T10:39:25.384 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 255 M 2021-08-03T10:39:25.384 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:39:25.420 INFO:teuthology.orchestra.run.smithi003.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 4.0 MB/s | 161 kB 00:00 2021-08-03T10:39:25.423 INFO:teuthology.orchestra.run.smithi003.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 62 MB/s | 187 kB 00:00 2021-08-03T10:39:25.428 INFO:teuthology.orchestra.run.smithi003.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 65 MB/s | 302 kB 00:00 2021-08-03T10:39:25.432 INFO:teuthology.orchestra.run.smithi003.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 59 MB/s | 250 kB 00:00 2021-08-03T10:39:25.522 INFO:teuthology.orchestra.run.smithi003.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 770 kB/s | 69 kB 00:00 2021-08-03T10:39:25.557 INFO:teuthology.orchestra.run.smithi003.stdout:(6/7): libcephsqlite-17.0.0-6630.gdf0bf89f.el8. 939 kB/s | 164 kB 00:00 2021-08-03T10:39:25.728 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:39:25.929 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-08-03T10:39:26.090 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-08-03T10:39:26.299 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-08-03T10:39:26.462 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-03T10:39:26.536 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-03T10:39:26.707 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-08-03T10:39:26.837 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/7 2021-08-03T10:39:27.545 INFO:teuthology.orchestra.run.smithi003.stdout:(7/7): ceph-test-17.0.0-6630.gdf0bf89f.el8.x86_ 22 MB/s | 47 MB 00:02 2021-08-03T10:39:27.549 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:39:27.550 INFO:teuthology.orchestra.run.smithi003.stdout:Total 22 MB/s | 48 MB 00:02 2021-08-03T10:39:27.554 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:39:27.581 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:39:27.581 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:39:27.937 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:39:27.942 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:39:28.844 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:39:28.988 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-08-03T10:39:29.176 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-08-03T10:39:29.357 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-08-03T10:39:29.527 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-03T10:39:29.617 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-03T10:39:29.773 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-08-03T10:39:29.902 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/7 2021-08-03T10:39:31.735 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/7 2021-08-03T10:39:31.951 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 7/7 2021-08-03T10:39:32.184 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 7/7 2021-08-03T10:39:32.184 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/7 2021-08-03T10:39:32.185 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/7 2021-08-03T10:39:32.185 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-08-03T10:39:32.185 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-03T10:39:32.185 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-08-03T10:39:32.186 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-08-03T10:39:32.561 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-08-03T10:39:32.562 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:39:32.820 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:32.821 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:39:32.821 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 jq-1.5-12.el8.x86_64 2021-08-03T10:39:32.821 INFO:teuthology.orchestra.run.smithi101.stdout: libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-08-03T10:39:32.822 INFO:teuthology.orchestra.run.smithi101.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-08-03T10:39:32.822 INFO:teuthology.orchestra.run.smithi101.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-08-03T10:39:32.822 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:32.822 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:39:33.045 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph 2021-08-03T10:39:33.576 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:00:48 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:39:34.496 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:39:34.499 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================= 2021-08-03T10:39:34.500 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:39:34.500 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================= 2021-08-03T10:39:34.500 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:39:34.501 INFO:teuthology.orchestra.run.smithi101.stdout: ceph x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 6.4 k 2021-08-03T10:39:34.501 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:39:34.501 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 2.2 M 2021-08-03T10:39:34.502 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.5 M 2021-08-03T10:39:34.502 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-modules-core noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 211 k 2021-08-03T10:39:34.502 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 7.2 M 2021-08-03T10:39:34.502 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 22 M 2021-08-03T10:39:34.503 INFO:teuthology.orchestra.run.smithi101.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-08-03T10:39:34.503 INFO:teuthology.orchestra.run.smithi101.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-08-03T10:39:34.503 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-08-03T10:39:34.503 INFO:teuthology.orchestra.run.smithi101.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-08-03T10:39:34.504 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-08-03T10:39:34.504 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-08-03T10:39:34.504 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-08-03T10:39:34.504 INFO:teuthology.orchestra.run.smithi101.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-08-03T10:39:34.504 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-08-03T10:39:34.505 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-08-03T10:39:34.505 INFO:teuthology.orchestra.run.smithi101.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-08-03T10:39:34.505 INFO:teuthology.orchestra.run.smithi101.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-08-03T10:39:34.506 INFO:teuthology.orchestra.run.smithi101.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-08-03T10:39:34.506 INFO:teuthology.orchestra.run.smithi101.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-08-03T10:39:34.506 INFO:teuthology.orchestra.run.smithi101.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-08-03T10:39:34.507 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-08-03T10:39:34.507 INFO:teuthology.orchestra.run.smithi101.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-08-03T10:39:34.507 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2021-08-03T10:39:34.507 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-08-03T10:39:34.507 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-08-03T10:39:34.508 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-08-03T10:39:34.508 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-08-03T10:39:34.508 INFO:teuthology.orchestra.run.smithi101.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-08-03T10:39:34.508 INFO:teuthology.orchestra.run.smithi101.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-08-03T10:39:34.509 INFO:teuthology.orchestra.run.smithi101.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-08-03T10:39:34.509 INFO:teuthology.orchestra.run.smithi101.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-08-03T10:39:34.509 INFO:teuthology.orchestra.run.smithi101.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-08-03T10:39:34.509 INFO:teuthology.orchestra.run.smithi101.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-08-03T10:39:34.510 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-08-03T10:39:34.510 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-08-03T10:39:34.510 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-08-03T10:39:34.510 INFO:teuthology.orchestra.run.smithi101.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-08-03T10:39:34.511 INFO:teuthology.orchestra.run.smithi101.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-08-03T10:39:34.511 INFO:teuthology.orchestra.run.smithi101.stdout:Installing weak dependencies: 2021-08-03T10:39:34.511 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-08-03T10:39:34.511 INFO:teuthology.orchestra.run.smithi101.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-08-03T10:39:34.512 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:34.512 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:39:34.512 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================= 2021-08-03T10:39:34.512 INFO:teuthology.orchestra.run.smithi101.stdout:Install 41 Packages 2021-08-03T10:39:34.513 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:34.513 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 39 M 2021-08-03T10:39:34.514 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 185 M 2021-08-03T10:39:34.514 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:39:34.606 INFO:teuthology.orchestra.run.smithi101.stdout:(1/41): ceph-17.0.0-6630.gdf0bf89f.el8.x86_64.r 64 kB/s | 6.4 kB 00:00 2021-08-03T10:39:34.808 INFO:teuthology.orchestra.run.smithi101.stdout:(2/41): ceph-mgr-17.0.0-6630.gdf0bf89f.el8.x86_ 4.8 MB/s | 1.5 MB 00:00 2021-08-03T10:39:34.859 INFO:teuthology.orchestra.run.smithi101.stdout:(3/41): ceph-mds-17.0.0-6630.gdf0bf89f.el8.x86_ 6.1 MB/s | 2.2 MB 00:00 2021-08-03T10:39:34.922 INFO:teuthology.orchestra.run.smithi101.stdout:(4/41): ceph-mgr-modules-core-17.0.0-6630.gdf0b 3.3 MB/s | 211 kB 00:00 2021-08-03T10:39:34.954 INFO:teuthology.orchestra.run.smithi101.stdout:(5/41): python3-html5lib-0.999999999-6.el8.noar 6.6 MB/s | 214 kB 00:00 2021-08-03T10:39:34.995 INFO:teuthology.orchestra.run.smithi101.stdout:(6/41): python3-lxml-4.2.3-2.el8.x86_64.rpm 37 MB/s | 1.5 MB 00:00 2021-08-03T10:39:35.084 INFO:teuthology.orchestra.run.smithi101.stdout:(7/41): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2021-08-03T10:39:35.129 INFO:teuthology.orchestra.run.smithi101.stdout:(8/41): python3-markupsafe-0.23-19.el8.x86_64.r 864 kB/s | 39 kB 00:00 2021-08-03T10:39:35.150 INFO:teuthology.orchestra.run.smithi101.stdout:(9/41): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.9 MB/s | 103 kB 00:00 2021-08-03T10:39:35.170 INFO:teuthology.orchestra.run.smithi101.stdout:(10/41): python3-pytz-2017.2-9.el8.noarch.rpm 2.7 MB/s | 54 kB 00:00 2021-08-03T10:39:35.206 INFO:teuthology.orchestra.run.smithi101.stdout:(11/41): python3-webencodings-0.5.1-6.el8.noarc 750 kB/s | 27 kB 00:00 2021-08-03T10:39:35.213 INFO:teuthology.orchestra.run.smithi101.stdout:(12/41): python3-werkzeug-0.12.2-4.el8.noarch.r 63 MB/s | 457 kB 00:00 2021-08-03T10:39:35.218 INFO:teuthology.orchestra.run.smithi101.stdout:(13/41): python3-cffi-1.11.5-5.el8.x86_64.rpm 49 MB/s | 237 kB 00:00 2021-08-03T10:39:35.222 INFO:teuthology.orchestra.run.smithi101.stdout:(14/41): python3-chardet-3.0.4-7.el8.noarch.rpm 59 MB/s | 195 kB 00:00 2021-08-03T10:39:35.229 INFO:teuthology.orchestra.run.smithi101.stdout:(15/41): python3-cryptography-3.2.1-4.el8.x86_6 75 MB/s | 559 kB 00:00 2021-08-03T10:39:35.232 INFO:teuthology.orchestra.run.smithi101.stdout:(16/41): python3-idna-2.5-5.el8.noarch.rpm 45 MB/s | 97 kB 00:00 2021-08-03T10:39:35.234 INFO:teuthology.orchestra.run.smithi101.stdout:(17/41): python3-pycparser-2.14-14.el8.noarch.r 52 MB/s | 109 kB 00:00 2021-08-03T10:39:35.236 INFO:teuthology.orchestra.run.smithi101.stdout:(18/41): python3-pysocks-1.6.8-3.el8.noarch.rpm 16 MB/s | 34 kB 00:00 2021-08-03T10:39:35.240 INFO:teuthology.orchestra.run.smithi101.stdout:(19/41): python3-requests-2.20.0-2.1.el8_1.noar 34 MB/s | 123 kB 00:00 2021-08-03T10:39:35.243 INFO:teuthology.orchestra.run.smithi101.stdout:(20/41): python3-urllib3-1.24.2-5.el8.noarch.rp 60 MB/s | 177 kB 00:00 2021-08-03T10:39:35.334 INFO:teuthology.orchestra.run.smithi101.stdout:(21/41): ceph-mon-17.0.0-6630.gdf0bf89f.el8.x86 9.9 MB/s | 7.2 MB 00:00 2021-08-03T10:39:35.394 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 6/7 2021-08-03T10:39:35.414 INFO:teuthology.orchestra.run.smithi101.stdout:(22/41): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 256 kB/s | 44 kB 00:00 2021-08-03T10:39:35.440 INFO:teuthology.orchestra.run.smithi101.stdout:(23/41): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.7 MB/s | 185 kB 00:00 2021-08-03T10:39:35.495 INFO:teuthology.orchestra.run.smithi101.stdout:(24/41): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.1 MB/s | 173 kB 00:00 2021-08-03T10:39:35.523 INFO:teuthology.orchestra.run.smithi101.stdout:(25/41): python3-cssselect-0.9.2-10.el8.noarch. 1.4 MB/s | 40 kB 00:00 2021-08-03T10:39:35.525 INFO:teuthology.orchestra.run.smithi101.stdout:(26/41): python3-cherrypy-18.4.0-1.el8.noarch.r 4.4 MB/s | 384 kB 00:00 2021-08-03T10:39:35.547 INFO:teuthology.orchestra.run.smithi101.stdout:(27/41): python3-jaraco-functools-2.0-4.el8.noa 809 kB/s | 18 kB 00:00 2021-08-03T10:39:35.550 INFO:teuthology.orchestra.run.smithi101.stdout:(28/41): python3-jaraco-6.2-6.el8.noarch.rpm 414 kB/s | 11 kB 00:00 2021-08-03T10:39:35.569 INFO:teuthology.orchestra.run.smithi101.stdout:(29/41): python3-logutils-0.3.5-11.el8.noarch.r 2.2 MB/s | 49 kB 00:00 2021-08-03T10:39:35.577 INFO:teuthology.orchestra.run.smithi101.stdout:(30/41): python3-more-itertools-7.2.0-3.el8.noa 2.1 MB/s | 59 kB 00:00 2021-08-03T10:39:35.604 INFO:teuthology.orchestra.run.smithi101.stdout:(31/41): python3-portend-2.6-1.el8.noarch.rpm 583 kB/s | 16 kB 00:00 2021-08-03T10:39:35.632 INFO:teuthology.orchestra.run.smithi101.stdout:(32/41): python3-simplegeneric-0.8.1-17.el8.noa 692 kB/s | 19 kB 00:00 2021-08-03T10:39:35.634 INFO:teuthology.orchestra.run.smithi101.stdout:(33/41): python3-pecan-1.3.2-9.el8.noarch.rpm 4.3 MB/s | 283 kB 00:00 2021-08-03T10:39:35.650 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 7/7 2021-08-03T10:39:35.655 INFO:teuthology.orchestra.run.smithi101.stdout:(34/41): python3-tempora-1.14.1-5.el8.noarch.rp 1.3 MB/s | 29 kB 00:00 2021-08-03T10:39:35.659 INFO:teuthology.orchestra.run.smithi101.stdout:(35/41): python3-singledispatch-3.4.0.3-18.el8. 887 kB/s | 24 kB 00:00 2021-08-03T10:39:35.677 INFO:teuthology.orchestra.run.smithi101.stdout:(36/41): python3-trustme-0.6.0-4.el8.noarch.rpm 1.2 MB/s | 27 kB 00:00 2021-08-03T10:39:35.721 INFO:teuthology.orchestra.run.smithi101.stdout:(37/41): python3-webob-1.8.5-1.el8.1.noarch.rpm 5.6 MB/s | 251 kB 00:00 2021-08-03T10:39:35.740 INFO:teuthology.orchestra.run.smithi101.stdout:(38/41): python3-waitress-1.2.1-2.el8.1.noarch. 2.9 MB/s | 241 kB 00:00 2021-08-03T10:39:35.743 INFO:teuthology.orchestra.run.smithi101.stdout:(39/41): python3-webtest-2.0.33-1.el8.noarch.rp 3.8 MB/s | 85 kB 00:00 2021-08-03T10:39:35.767 INFO:teuthology.orchestra.run.smithi101.stdout:(40/41): python3-zc-lockfile-2.0-2.el8.noarch.r 845 kB/s | 23 kB 00:00 2021-08-03T10:39:35.909 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 7/7 2021-08-03T10:39:35.910 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/7 2021-08-03T10:39:35.910 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/7 2021-08-03T10:39:35.910 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-08-03T10:39:35.911 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-03T10:39:35.911 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-08-03T10:39:35.911 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-08-03T10:39:35.931 INFO:teuthology.orchestra.run.smithi101.stdout:(41/41): ceph-osd-17.0.0-6630.gdf0bf89f.el8.x86 19 MB/s | 22 MB 00:01 2021-08-03T10:39:35.934 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:39:35.935 INFO:teuthology.orchestra.run.smithi101.stdout:Total 27 MB/s | 39 MB 00:01 2021-08-03T10:39:35.948 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:39:35.988 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:39:35.988 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:39:36.282 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-08-03T10:39:36.283 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:39:36.319 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:39:36.322 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:39:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:36.578 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:39:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:17.0.0-6630.gdf0bf89f.el8.x86_64 jq-1.5-12.el8.x86_64 2021-08-03T10:39:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:17.0.0-6630.gdf0bf89f.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-08-03T10:39:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-08-03T10:39:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-08-03T10:39:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:36.580 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:39:36.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph 2021-08-03T10:39:37.323 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:51 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:39:37.769 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:39:37.961 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/41 2021-08-03T10:39:38.122 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/41 2021-08-03T10:39:38.286 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-idna-2.5-5.el8.noarch 3/41 2021-08-03T10:39:38.293 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:39:38.297 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2021-08-03T10:39:38.298 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:39:38.298 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2021-08-03T10:39:38.298 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:39:38.298 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 6.4 k 2021-08-03T10:39:38.299 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:39:38.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 2.2 M 2021-08-03T10:39:38.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.5 M 2021-08-03T10:39:38.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 211 k 2021-08-03T10:39:38.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 7.2 M 2021-08-03T10:39:38.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 22 M 2021-08-03T10:39:38.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-08-03T10:39:38.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-08-03T10:39:38.300 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-08-03T10:39:38.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-08-03T10:39:38.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-08-03T10:39:38.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-08-03T10:39:38.301 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-08-03T10:39:38.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-08-03T10:39:38.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-08-03T10:39:38.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-08-03T10:39:38.302 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-08-03T10:39:38.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-08-03T10:39:38.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-08-03T10:39:38.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-08-03T10:39:38.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-08-03T10:39:38.303 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-08-03T10:39:38.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-08-03T10:39:38.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2021-08-03T10:39:38.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-08-03T10:39:38.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-08-03T10:39:38.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-08-03T10:39:38.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-08-03T10:39:38.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-08-03T10:39:38.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-08-03T10:39:38.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-08-03T10:39:38.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-08-03T10:39:38.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-08-03T10:39:38.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-08-03T10:39:38.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-08-03T10:39:38.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-08-03T10:39:38.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-08-03T10:39:38.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-08-03T10:39:38.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-08-03T10:39:38.307 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2021-08-03T10:39:38.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-08-03T10:39:38.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-08-03T10:39:38.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:38.308 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:39:38.309 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2021-08-03T10:39:38.309 INFO:teuthology.orchestra.run.smithi003.stdout:Install 41 Packages 2021-08-03T10:39:38.309 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:38.310 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 39 M 2021-08-03T10:39:38.310 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 185 M 2021-08-03T10:39:38.310 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:39:38.407 INFO:teuthology.orchestra.run.smithi003.stdout:(1/41): ceph-17.0.0-6630.gdf0bf89f.el8.x86_64.r 63 kB/s | 6.4 kB 00:00 2021-08-03T10:39:38.485 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/41 2021-08-03T10:39:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:(2/41): ceph-mgr-17.0.0-6630.gdf0bf89f.el8.x86_ 4.7 MB/s | 1.5 MB 00:00 2021-08-03T10:39:38.655 INFO:teuthology.orchestra.run.smithi003.stdout:(3/41): ceph-mds-17.0.0-6630.gdf0bf89f.el8.x86_ 6.1 MB/s | 2.2 MB 00:00 2021-08-03T10:39:38.710 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/41 2021-08-03T10:39:38.713 INFO:teuthology.orchestra.run.smithi003.stdout:(4/41): ceph-mgr-modules-core-17.0.0-6630.gdf0b 3.6 MB/s | 211 kB 00:00 2021-08-03T10:39:38.746 INFO:teuthology.orchestra.run.smithi003.stdout:(5/41): python3-html5lib-0.999999999-6.el8.noar 6.4 MB/s | 214 kB 00:00 2021-08-03T10:39:38.764 INFO:teuthology.orchestra.run.smithi003.stdout:(6/41): python3-lxml-4.2.3-2.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2021-08-03T10:39:38.767 INFO:teuthology.orchestra.run.smithi003.stdout:(7/41): python3-mako-1.0.6-13.el8.noarch.rpm 59 MB/s | 157 kB 00:00 2021-08-03T10:39:38.768 INFO:teuthology.orchestra.run.smithi003.stdout:(8/41): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2021-08-03T10:39:38.770 INFO:teuthology.orchestra.run.smithi003.stdout:(9/41): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 54 MB/s | 103 kB 00:00 2021-08-03T10:39:38.772 INFO:teuthology.orchestra.run.smithi003.stdout:(10/41): python3-pytz-2017.2-9.el8.noarch.rpm 37 MB/s | 54 kB 00:00 2021-08-03T10:39:38.773 INFO:teuthology.orchestra.run.smithi003.stdout:(11/41): python3-webencodings-0.5.1-6.el8.noarc 26 MB/s | 27 kB 00:00 2021-08-03T10:39:38.780 INFO:teuthology.orchestra.run.smithi003.stdout:(12/41): python3-werkzeug-0.12.2-4.el8.noarch.r 65 MB/s | 457 kB 00:00 2021-08-03T10:39:38.784 INFO:teuthology.orchestra.run.smithi003.stdout:(13/41): python3-cffi-1.11.5-5.el8.x86_64.rpm 68 MB/s | 237 kB 00:00 2021-08-03T10:39:38.787 INFO:teuthology.orchestra.run.smithi003.stdout:(14/41): python3-chardet-3.0.4-7.el8.noarch.rpm 64 MB/s | 195 kB 00:00 2021-08-03T10:39:38.794 INFO:teuthology.orchestra.run.smithi003.stdout:(15/41): python3-cryptography-3.2.1-4.el8.x86_6 78 MB/s | 559 kB 00:00 2021-08-03T10:39:38.796 INFO:teuthology.orchestra.run.smithi003.stdout:(16/41): python3-idna-2.5-5.el8.noarch.rpm 53 MB/s | 97 kB 00:00 2021-08-03T10:39:38.798 INFO:teuthology.orchestra.run.smithi003.stdout:(17/41): python3-pycparser-2.14-14.el8.noarch.r 54 MB/s | 109 kB 00:00 2021-08-03T10:39:38.799 INFO:teuthology.orchestra.run.smithi003.stdout:(18/41): python3-pysocks-1.6.8-3.el8.noarch.rpm 31 MB/s | 34 kB 00:00 2021-08-03T10:39:38.802 INFO:teuthology.orchestra.run.smithi003.stdout:(19/41): python3-requests-2.20.0-2.1.el8_1.noar 56 MB/s | 123 kB 00:00 2021-08-03T10:39:38.805 INFO:teuthology.orchestra.run.smithi003.stdout:(20/41): python3-urllib3-1.24.2-5.el8.noarch.rp 61 MB/s | 177 kB 00:00 2021-08-03T10:39:38.857 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/41 2021-08-03T10:39:38.910 INFO:teuthology.orchestra.run.smithi003.stdout:(21/41): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 418 kB/s | 44 kB 00:00 2021-08-03T10:39:38.988 INFO:teuthology.orchestra.run.smithi003.stdout:(22/41): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.3 MB/s | 185 kB 00:00 2021-08-03T10:39:39.041 INFO:teuthology.orchestra.run.smithi003.stdout:(23/41): python3-cheroot-8.5.2-1.el8.noarch.rpm 3.2 MB/s | 173 kB 00:00 2021-08-03T10:39:39.056 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/41 2021-08-03T10:39:39.084 INFO:teuthology.orchestra.run.smithi003.stdout:(24/41): ceph-mon-17.0.0-6630.gdf0bf89f.el8.x86 11 MB/s | 7.2 MB 00:00 2021-08-03T10:39:39.146 INFO:teuthology.orchestra.run.smithi003.stdout:(25/41): python3-cherrypy-18.4.0-1.el8.noarch.r 3.6 MB/s | 384 kB 00:00 2021-08-03T10:39:39.150 INFO:teuthology.orchestra.run.smithi003.stdout:(26/41): python3-cssselect-0.9.2-10.el8.noarch. 605 kB/s | 40 kB 00:00 2021-08-03T10:39:39.172 INFO:teuthology.orchestra.run.smithi003.stdout:(27/41): python3-jaraco-6.2-6.el8.noarch.rpm 425 kB/s | 11 kB 00:00 2021-08-03T10:39:39.173 INFO:teuthology.orchestra.run.smithi003.stdout:(28/41): python3-jaraco-functools-2.0-4.el8.noa 788 kB/s | 18 kB 00:00 2021-08-03T10:39:39.197 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/41 2021-08-03T10:39:39.198 INFO:teuthology.orchestra.run.smithi003.stdout:(29/41): python3-logutils-0.3.5-11.el8.noarch.r 1.8 MB/s | 49 kB 00:00 2021-08-03T10:39:39.217 INFO:teuthology.orchestra.run.smithi003.stdout:(30/41): python3-more-itertools-7.2.0-3.el8.noa 1.3 MB/s | 59 kB 00:00 2021-08-03T10:39:39.239 INFO:teuthology.orchestra.run.smithi003.stdout:(31/41): python3-portend-2.6-1.el8.noarch.rpm 705 kB/s | 16 kB 00:00 2021-08-03T10:39:39.261 INFO:teuthology.orchestra.run.smithi003.stdout:(32/41): python3-simplegeneric-0.8.1-17.el8.noa 845 kB/s | 19 kB 00:00 2021-08-03T10:39:39.277 INFO:teuthology.orchestra.run.smithi003.stdout:(33/41): python3-pecan-1.3.2-9.el8.noarch.rpm 3.5 MB/s | 283 kB 00:00 2021-08-03T10:39:39.284 INFO:teuthology.orchestra.run.smithi003.stdout:(34/41): python3-singledispatch-3.4.0.3-18.el8. 1.1 MB/s | 24 kB 00:00 2021-08-03T10:39:39.304 INFO:teuthology.orchestra.run.smithi003.stdout:(35/41): python3-tempora-1.14.1-5.el8.noarch.rp 1.1 MB/s | 29 kB 00:00 2021-08-03T10:39:39.306 INFO:teuthology.orchestra.run.smithi003.stdout:(36/41): python3-trustme-0.6.0-4.el8.noarch.rpm 1.2 MB/s | 27 kB 00:00 2021-08-03T10:39:39.343 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/41 2021-08-03T10:39:39.357 INFO:teuthology.orchestra.run.smithi003.stdout:(37/41): python3-waitress-1.2.1-2.el8.1.noarch. 4.4 MB/s | 241 kB 00:00 2021-08-03T10:39:39.373 INFO:teuthology.orchestra.run.smithi003.stdout:(38/41): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.7 MB/s | 251 kB 00:00 2021-08-03T10:39:39.384 INFO:teuthology.orchestra.run.smithi003.stdout:(39/41): python3-webtest-2.0.33-1.el8.noarch.rp 3.1 MB/s | 85 kB 00:00 2021-08-03T10:39:39.395 INFO:teuthology.orchestra.run.smithi003.stdout:(40/41): python3-zc-lockfile-2.0-2.el8.noarch.r 1.0 MB/s | 23 kB 00:00 2021-08-03T10:39:39.507 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/41 2021-08-03T10:39:39.645 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/41 2021-08-03T10:39:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:(41/41): ceph-osd-17.0.0-6630.gdf0bf89f.el8.x86 19 MB/s | 22 MB 00:01 2021-08-03T10:39:39.756 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:39:39.756 INFO:teuthology.orchestra.run.smithi003.stdout:Total 27 MB/s | 39 MB 00:01 2021-08-03T10:39:39.771 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:39:39.817 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:39:39.817 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:39:39.880 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/41 2021-08-03T10:39:40.113 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 13/41 2021-08-03T10:39:40.162 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:39:40.165 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:39:40.339 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/41 2021-08-03T10:39:40.740 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-08-03T10:39:40.998 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 16/41 2021-08-03T10:39:41.161 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 17/41 2021-08-03T10:39:41.416 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 18/41 2021-08-03T10:39:41.621 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 19/41 2021-08-03T10:39:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:39:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/41 2021-08-03T10:39:41.877 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 20/41 2021-08-03T10:39:42.038 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/41 2021-08-03T10:39:42.111 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 21/41 2021-08-03T10:39:42.193 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-idna-2.5-5.el8.noarch 3/41 2021-08-03T10:39:42.379 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 22/41 2021-08-03T10:39:42.467 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/41 2021-08-03T10:39:42.556 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/41 2021-08-03T10:39:42.674 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/41 2021-08-03T10:39:42.758 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 24/41 2021-08-03T10:39:42.838 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/41 2021-08-03T10:39:42.949 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 25/41 2021-08-03T10:39:43.023 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/41 2021-08-03T10:39:43.179 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/41 2021-08-03T10:39:43.311 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 26/41 2021-08-03T10:39:43.358 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/41 2021-08-03T10:39:43.540 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/41 2021-08-03T10:39:43.591 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 27/41 2021-08-03T10:39:43.685 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/41 2021-08-03T10:39:43.767 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 28/41 2021-08-03T10:39:43.909 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/41 2021-08-03T10:39:43.972 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/41 2021-08-03T10:39:44.141 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 30/41 2021-08-03T10:39:44.174 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 13/41 2021-08-03T10:39:44.407 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/41 2021-08-03T10:39:44.416 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-portend-2.6-1.el8.noarch 31/41 2021-08-03T10:39:44.673 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 32/41 2021-08-03T10:39:44.830 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-08-03T10:39:44.885 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/41 2021-08-03T10:39:45.055 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 16/41 2021-08-03T10:39:45.239 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/41 2021-08-03T10:39:45.267 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 17/41 2021-08-03T10:39:45.518 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 18/41 2021-08-03T10:39:45.575 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 35/41 2021-08-03T10:39:45.736 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 19/41 2021-08-03T10:39:45.984 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-6630.gdf0bf89f.el8. 36/41 2021-08-03T10:39:45.987 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 20/41 2021-08-03T10:39:46.198 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 37/41 2021-08-03T10:39:46.202 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 21/41 2021-08-03T10:39:46.496 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 22/41 2021-08-03T10:39:46.670 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/41 2021-08-03T10:39:46.902 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 24/41 2021-08-03T10:39:47.115 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 25/41 2021-08-03T10:39:47.469 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 26/41 2021-08-03T10:39:47.710 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 27/41 2021-08-03T10:39:47.907 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 28/41 2021-08-03T10:39:48.121 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/41 2021-08-03T10:39:48.314 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 30/41 2021-08-03T10:39:48.368 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 37/41 2021-08-03T10:39:48.587 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-2.6-1.el8.noarch 31/41 2021-08-03T10:39:48.639 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 38/41 2021-08-03T10:39:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 32/41 2021-08-03T10:39:49.078 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/41 2021-08-03T10:39:49.372 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 38/41 2021-08-03T10:39:49.455 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/41 2021-08-03T10:39:49.564 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 39/41 2021-08-03T10:39:49.780 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 39/41 2021-08-03T10:39:49.799 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 35/41 2021-08-03T10:39:49.993 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 40/41 2021-08-03T10:39:50.010 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 40/41 2021-08-03T10:39:50.142 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 41/41 2021-08-03T10:39:50.194 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-6630.gdf0bf89f.el8. 36/41 2021-08-03T10:39:50.415 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 37/41 2021-08-03T10:39:50.539 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 41/41 2021-08-03T10:39:50.540 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/41 2021-08-03T10:39:50.540 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/41 2021-08-03T10:39:50.540 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/41 2021-08-03T10:39:50.540 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 4/41 2021-08-03T10:39:50.541 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/41 2021-08-03T10:39:50.541 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-6630.gdf0bf89f.el8. 6/41 2021-08-03T10:39:50.541 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/41 2021-08-03T10:39:50.541 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/41 2021-08-03T10:39:50.541 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/41 2021-08-03T10:39:50.542 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/41 2021-08-03T10:39:50.542 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 11/41 2021-08-03T10:39:50.542 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/41 2021-08-03T10:39:50.542 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/41 2021-08-03T10:39:50.543 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/41 2021-08-03T10:39:50.543 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-08-03T10:39:50.543 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 16/41 2021-08-03T10:39:50.543 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 17/41 2021-08-03T10:39:50.543 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-idna-2.5-5.el8.noarch 18/41 2021-08-03T10:39:50.544 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 19/41 2021-08-03T10:39:50.544 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 20/41 2021-08-03T10:39:50.544 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 21/41 2021-08-03T10:39:50.544 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 22/41 2021-08-03T10:39:50.545 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 23/41 2021-08-03T10:39:50.545 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/41 2021-08-03T10:39:50.545 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 25/41 2021-08-03T10:39:50.545 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 26/41 2021-08-03T10:39:50.545 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 27/41 2021-08-03T10:39:50.547 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 28/41 2021-08-03T10:39:50.547 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 29/41 2021-08-03T10:39:50.548 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 30/41 2021-08-03T10:39:50.548 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 31/41 2021-08-03T10:39:50.548 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 32/41 2021-08-03T10:39:50.548 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-portend-2.6-1.el8.noarch 33/41 2021-08-03T10:39:50.549 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 34/41 2021-08-03T10:39:50.549 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 35/41 2021-08-03T10:39:50.549 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 36/41 2021-08-03T10:39:50.549 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 37/41 2021-08-03T10:39:50.549 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 38/41 2021-08-03T10:39:50.550 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 39/41 2021-08-03T10:39:50.550 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 40/41 2021-08-03T10:39:51.861 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 41/41 2021-08-03T10:39:51.861 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:39:52.127 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:52.128 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:39:52.129 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:52.129 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:52.129 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:52.130 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-modules-core-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:39:52.130 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:52.131 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:52.131 INFO:teuthology.orchestra.run.smithi101.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-08-03T10:39:52.132 INFO:teuthology.orchestra.run.smithi101.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-08-03T10:39:52.132 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-08-03T10:39:52.132 INFO:teuthology.orchestra.run.smithi101.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-08-03T10:39:52.133 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-08-03T10:39:52.133 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-08-03T10:39:52.134 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-08-03T10:39:52.134 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-08-03T10:39:52.134 INFO:teuthology.orchestra.run.smithi101.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-08-03T10:39:52.135 INFO:teuthology.orchestra.run.smithi101.stdout: python3-idna-2.5-5.el8.noarch 2021-08-03T10:39:52.135 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-6.2-6.el8.noarch 2021-08-03T10:39:52.136 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-08-03T10:39:52.136 INFO:teuthology.orchestra.run.smithi101.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-08-03T10:39:52.136 INFO:teuthology.orchestra.run.smithi101.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-08-03T10:39:52.137 INFO:teuthology.orchestra.run.smithi101.stdout: python3-mako-1.0.6-13.el8.noarch 2021-08-03T10:39:52.137 INFO:teuthology.orchestra.run.smithi101.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-08-03T10:39:52.138 INFO:teuthology.orchestra.run.smithi101.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-08-03T10:39:52.138 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-08-03T10:39:52.138 INFO:teuthology.orchestra.run.smithi101.stdout: python3-portend-2.6-1.el8.noarch 2021-08-03T10:39:52.139 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-08-03T10:39:52.139 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pycparser-2.14-14.el8.noarch 2021-08-03T10:39:52.140 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-08-03T10:39:52.140 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pytz-2017.2-9.el8.noarch 2021-08-03T10:39:52.140 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-08-03T10:39:52.140 INFO:teuthology.orchestra.run.smithi101.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-08-03T10:39:52.141 INFO:teuthology.orchestra.run.smithi101.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-08-03T10:39:52.141 INFO:teuthology.orchestra.run.smithi101.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-08-03T10:39:52.141 INFO:teuthology.orchestra.run.smithi101.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-08-03T10:39:52.141 INFO:teuthology.orchestra.run.smithi101.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-08-03T10:39:52.142 INFO:teuthology.orchestra.run.smithi101.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-08-03T10:39:52.142 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-08-03T10:39:52.142 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-08-03T10:39:52.142 INFO:teuthology.orchestra.run.smithi101.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-08-03T10:39:52.142 INFO:teuthology.orchestra.run.smithi101.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-08-03T10:39:52.143 INFO:teuthology.orchestra.run.smithi101.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-08-03T10:39:52.143 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:52.143 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:39:52.374 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-base 2021-08-03T10:39:52.754 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 37/41 2021-08-03T10:39:52.915 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:07 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:39:52.998 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 38/41 2021-08-03T10:39:53.584 INFO:teuthology.orchestra.run.smithi101.stdout:Package ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:39:53.772 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 38/41 2021-08-03T10:39:53.813 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:39:53.814 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:39:53.814 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:39:53.870 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install cephadm 2021-08-03T10:39:53.964 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 39/41 2021-08-03T10:39:54.195 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 39/41 2021-08-03T10:39:54.390 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 40/41 2021-08-03T10:39:54.408 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 40/41 2021-08-03T10:39:54.409 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:09 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:39:54.531 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 41/41 2021-08-03T10:39:54.946 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 41/41 2021-08-03T10:39:54.947 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/41 2021-08-03T10:39:54.947 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/41 2021-08-03T10:39:54.947 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 3/41 2021-08-03T10:39:54.948 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 4/41 2021-08-03T10:39:54.948 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 5/41 2021-08-03T10:39:54.948 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-6630.gdf0bf89f.el8. 6/41 2021-08-03T10:39:54.948 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/41 2021-08-03T10:39:54.949 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/41 2021-08-03T10:39:54.949 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/41 2021-08-03T10:39:54.949 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/41 2021-08-03T10:39:54.949 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 11/41 2021-08-03T10:39:54.950 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/41 2021-08-03T10:39:54.950 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/41 2021-08-03T10:39:54.950 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/41 2021-08-03T10:39:54.951 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-08-03T10:39:54.951 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 16/41 2021-08-03T10:39:54.951 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 17/41 2021-08-03T10:39:54.951 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-idna-2.5-5.el8.noarch 18/41 2021-08-03T10:39:54.952 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 19/41 2021-08-03T10:39:54.952 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 20/41 2021-08-03T10:39:54.952 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 21/41 2021-08-03T10:39:54.952 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 22/41 2021-08-03T10:39:54.952 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 23/41 2021-08-03T10:39:54.953 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/41 2021-08-03T10:39:54.953 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 25/41 2021-08-03T10:39:54.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 26/41 2021-08-03T10:39:54.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 27/41 2021-08-03T10:39:54.956 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 28/41 2021-08-03T10:39:54.956 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 29/41 2021-08-03T10:39:54.956 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 30/41 2021-08-03T10:39:54.957 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 31/41 2021-08-03T10:39:54.957 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 32/41 2021-08-03T10:39:54.958 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-2.6-1.el8.noarch 33/41 2021-08-03T10:39:54.958 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 34/41 2021-08-03T10:39:54.959 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 35/41 2021-08-03T10:39:54.959 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 36/41 2021-08-03T10:39:54.959 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 37/41 2021-08-03T10:39:54.960 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 38/41 2021-08-03T10:39:54.960 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 39/41 2021-08-03T10:39:54.960 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 40/41 2021-08-03T10:39:55.326 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:39:55.327 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:39:55.327 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:39:55.327 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:39:55.327 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:39:55.328 INFO:teuthology.orchestra.run.smithi101.stdout: cephadm noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 68 k 2021-08-03T10:39:55.328 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:55.328 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:39:55.328 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:39:55.329 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:39:55.329 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:55.329 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 68 k 2021-08-03T10:39:55.329 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 300 k 2021-08-03T10:39:55.329 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:39:55.475 INFO:teuthology.orchestra.run.smithi101.stdout:cephadm-17.0.0-6630.gdf0bf89f.el8.noarch.rpm 461 kB/s | 68 kB 00:00 2021-08-03T10:39:55.475 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:39:55.476 INFO:teuthology.orchestra.run.smithi101.stdout:Total 457 kB/s | 68 kB 00:00 2021-08-03T10:39:55.476 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:39:55.482 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:39:55.482 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:39:55.484 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:39:55.487 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:39:55.560 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:39:55.676 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 41/41 2021-08-03T10:39:55.677 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:39:56.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:39:56.178 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:39:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:56.179 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:39:56.180 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-08-03T10:39:56.180 INFO:teuthology.orchestra.run.smithi003.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-08-03T10:39:56.180 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-08-03T10:39:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-08-03T10:39:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-08-03T10:39:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-08-03T10:39:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-08-03T10:39:56.181 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-08-03T10:39:56.182 INFO:teuthology.orchestra.run.smithi003.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-08-03T10:39:56.182 INFO:teuthology.orchestra.run.smithi003.stdout: python3-idna-2.5-5.el8.noarch 2021-08-03T10:39:56.182 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-6.2-6.el8.noarch 2021-08-03T10:39:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-08-03T10:39:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-08-03T10:39:56.183 INFO:teuthology.orchestra.run.smithi003.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-08-03T10:39:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.0.6-13.el8.noarch 2021-08-03T10:39:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-08-03T10:39:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-08-03T10:39:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-08-03T10:39:56.184 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-2.6-1.el8.noarch 2021-08-03T10:39:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-08-03T10:39:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.14-14.el8.noarch 2021-08-03T10:39:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-08-03T10:39:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2017.2-9.el8.noarch 2021-08-03T10:39:56.185 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-08-03T10:39:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-08-03T10:39:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-08-03T10:39:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-08-03T10:39:56.186 INFO:teuthology.orchestra.run.smithi003.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-08-03T10:39:56.187 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-08-03T10:39:56.187 INFO:teuthology.orchestra.run.smithi003.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-08-03T10:39:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-08-03T10:39:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-08-03T10:39:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-08-03T10:39:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-08-03T10:39:56.188 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-08-03T10:39:56.189 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:56.189 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:39:56.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-base 2021-08-03T10:39:56.979 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:10 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:39:57.688 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-base-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:39:57.930 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:39:57.931 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:39:57.931 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:39:58.001 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install cephadm 2021-08-03T10:39:58.579 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:12 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:39:58.736 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:39:58.900 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:39:59.081 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:39:59.337 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:39:59.337 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:39:59.531 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:39:59.532 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:39:59.532 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:39:59.532 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:39:59.533 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:39:59.533 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 68 k 2021-08-03T10:39:59.533 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:59.533 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:39:59.534 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:39:59.534 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:39:59.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:39:59.534 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 68 k 2021-08-03T10:39:59.535 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 300 k 2021-08-03T10:39:59.535 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:39:59.550 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:59.550 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:39:59.550 INFO:teuthology.orchestra.run.smithi101.stdout: cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:39:59.551 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:39:59.551 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:39:59.680 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm-17.0.0-6630.gdf0bf89f.el8.noarch.rpm 460 kB/s | 68 kB 00:00 2021-08-03T10:39:59.681 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:39:59.681 INFO:teuthology.orchestra.run.smithi003.stdout:Total 456 kB/s | 68 kB 00:00 2021-08-03T10:39:59.681 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:39:59.688 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:39:59.688 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:39:59.690 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:39:59.693 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:39:59.709 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-immutable-object-cache 2021-08-03T10:39:59.737 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:00.272 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:15 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:01.171 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:01.172 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:01.172 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:40:01.172 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:01.172 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:01.173 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 153 k 2021-08-03T10:40:01.173 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:01.173 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:01.173 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:01.174 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:40:01.174 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:01.174 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 153 k 2021-08-03T10:40:01.174 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 578 k 2021-08-03T10:40:01.174 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:01.343 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-immutable-object-cache-17.0.0-6630.gdf0bf8 897 kB/s | 153 kB 00:00 2021-08-03T10:40:01.344 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:01.344 INFO:teuthology.orchestra.run.smithi101.stdout:Total 891 kB/s | 153 kB 00:00 2021-08-03T10:40:01.344 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:01.356 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:01.356 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:01.404 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:01.407 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:01.525 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:01.750 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f. 1/1 2021-08-03T10:40:02.117 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f. 1/1 2021-08-03T10:40:02.348 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f. 1/1 2021-08-03T10:40:02.348 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:02.588 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:02.589 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:02.589 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:40:02.589 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:02.589 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:40:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:40:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:40:03.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/1 2021-08-03T10:40:03.612 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:03.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:03.867 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:03.868 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:03.868 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:03.868 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:03.914 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mgr 2021-08-03T10:40:04.055 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-immutable-object-cache 2021-08-03T10:40:04.513 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:19 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:04.643 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:18 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:05.199 INFO:teuthology.orchestra.run.smithi101.stdout:Package ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:05.428 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:05.429 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:05.430 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:05.483 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mgr-dashboard 2021-08-03T10:40:05.611 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:05.613 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:05.613 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:40:05.613 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:05.613 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:05.614 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 153 k 2021-08-03T10:40:05.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:05.614 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:05.614 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:05.615 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:40:05.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:05.615 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 153 k 2021-08-03T10:40:05.615 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 578 k 2021-08-03T10:40:05.616 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:05.787 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-immutable-object-cache-17.0.0-6630.gdf0bf8 880 kB/s | 153 kB 00:00 2021-08-03T10:40:05.788 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:05.788 INFO:teuthology.orchestra.run.smithi003.stdout:Total 873 kB/s | 153 kB 00:00 2021-08-03T10:40:05.789 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:05.801 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:05.801 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:05.853 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:05.856 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:05.990 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:06.025 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:21 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:06.213 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f. 1/1 2021-08-03T10:40:06.603 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f. 1/1 2021-08-03T10:40:06.847 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f. 1/1 2021-08-03T10:40:06.848 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:06.931 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:06.932 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:06.933 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:40:06.933 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:06.933 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:06.933 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-dashboard noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 1.5 M 2021-08-03T10:40:06.934 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:40:06.934 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-grafana-dashboards noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 23 k 2021-08-03T10:40:06.934 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-prometheus-alerts noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 8.9 k 2021-08-03T10:40:06.934 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-08-03T10:40:06.934 INFO:teuthology.orchestra.run.smithi101.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-08-03T10:40:06.935 INFO:teuthology.orchestra.run.smithi101.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-08-03T10:40:06.935 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:06.935 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:06.935 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:06.936 INFO:teuthology.orchestra.run.smithi101.stdout:Install 6 Packages 2021-08-03T10:40:06.936 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:06.936 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 1.8 M 2021-08-03T10:40:06.937 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 7.4 M 2021-08-03T10:40:06.937 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:07.041 INFO:teuthology.orchestra.run.smithi101.stdout:(1/6): ceph-prometheus-alerts-17.0.0-6630.gdf0b 84 kB/s | 8.9 kB 00:00 2021-08-03T10:40:07.068 INFO:teuthology.orchestra.run.smithi101.stdout:(2/6): ceph-grafana-dashboards-17.0.0-6630.gdf0 176 kB/s | 23 kB 00:00 2021-08-03T10:40:07.077 INFO:teuthology.orchestra.run.smithi101.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2021-08-03T10:40:07.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:07.112 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:07.113 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:40:07.113 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:07.113 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:07.135 INFO:teuthology.orchestra.run.smithi101.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 498 kB/s | 34 kB 00:00 2021-08-03T10:40:07.209 INFO:teuthology.orchestra.run.smithi101.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.5 MB/s | 196 kB 00:00 2021-08-03T10:40:07.233 INFO:teuthology.orchestra.run.smithi101.stdout:(6/6): ceph-mgr-dashboard-17.0.0-6630.gdf0bf89f 5.1 MB/s | 1.5 MB 00:00 2021-08-03T10:40:07.236 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:07.236 INFO:teuthology.orchestra.run.smithi101.stdout:Total 6.1 MB/s | 1.8 MB 00:00 2021-08-03T10:40:07.237 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:07.245 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:07.245 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:07.283 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr 2021-08-03T10:40:07.302 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:07.305 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:07.578 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:07.773 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-08-03T10:40:07.862 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:21 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:08.001 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-08-03T10:40:08.242 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-08-03T10:40:08.339 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-6630.gdf0bf89f.el8.n 4/6 2021-08-03T10:40:08.675 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-6630.gdf0bf89f.el8. 5/6 2021-08-03T10:40:08.869 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarc 6/6 2021-08-03T10:40:08.944 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-mgr-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:09.128 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarc 6/6 2021-08-03T10:40:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-6630.gdf0bf89f.el8. 1/6 2021-08-03T10:40:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarc 2/6 2021-08-03T10:40:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-6630.gdf0bf89f.el8.n 3/6 2021-08-03T10:40:09.129 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-08-03T10:40:09.130 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-08-03T10:40:09.187 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:09.188 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:09.188 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:09.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-dashboard 2021-08-03T10:40:09.381 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-08-03T10:40:09.381 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:09.596 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:09.597 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:09.597 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-grafana-dashboards-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:09.597 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:09.598 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-prometheus-alerts-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:09.598 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-08-03T10:40:09.598 INFO:teuthology.orchestra.run.smithi101.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-08-03T10:40:09.598 INFO:teuthology.orchestra.run.smithi101.stdout: python3-routes-2.4.1-12.el8.noarch 2021-08-03T10:40:09.598 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:09.599 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:09.667 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mgr-diskprediction-local 2021-08-03T10:40:09.882 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:23 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:10.210 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:25 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:10.852 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:10.853 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:10.853 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:40:10.853 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:10.853 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:10.854 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 1.5 M 2021-08-03T10:40:10.854 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:40:10.854 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 23 k 2021-08-03T10:40:10.854 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 8.9 k 2021-08-03T10:40:10.855 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-08-03T10:40:10.855 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-08-03T10:40:10.855 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-08-03T10:40:10.856 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:10.856 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:10.856 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:10.857 INFO:teuthology.orchestra.run.smithi003.stdout:Install 6 Packages 2021-08-03T10:40:10.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:10.858 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 1.8 M 2021-08-03T10:40:10.858 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 7.4 M 2021-08-03T10:40:10.859 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:10.963 INFO:teuthology.orchestra.run.smithi003.stdout:(1/6): ceph-prometheus-alerts-17.0.0-6630.gdf0b 83 kB/s | 8.9 kB 00:00 2021-08-03T10:40:10.996 INFO:teuthology.orchestra.run.smithi003.stdout:(2/6): ceph-grafana-dashboards-17.0.0-6630.gdf0 166 kB/s | 23 kB 00:00 2021-08-03T10:40:11.026 INFO:teuthology.orchestra.run.smithi003.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 680 kB/s | 43 kB 00:00 2021-08-03T10:40:11.064 INFO:teuthology.orchestra.run.smithi003.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 495 kB/s | 34 kB 00:00 2021-08-03T10:40:11.122 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:11.123 INFO:teuthology.orchestra.run.smithi101.stdout:===================================================================================================== 2021-08-03T10:40:11.123 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:40:11.123 INFO:teuthology.orchestra.run.smithi101.stdout:===================================================================================================== 2021-08-03T10:40:11.124 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:11.124 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 7.4 M 2021-08-03T10:40:11.124 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:40:11.124 INFO:teuthology.orchestra.run.smithi101.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-08-03T10:40:11.125 INFO:teuthology.orchestra.run.smithi101.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-08-03T10:40:11.125 INFO:teuthology.orchestra.run.smithi101.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-08-03T10:40:11.125 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-08-03T10:40:11.125 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-08-03T10:40:11.126 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-08-03T10:40:11.126 INFO:teuthology.orchestra.run.smithi101.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-08-03T10:40:11.126 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:11.126 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:11.127 INFO:teuthology.orchestra.run.smithi101.stdout:===================================================================================================== 2021-08-03T10:40:11.127 INFO:teuthology.orchestra.run.smithi101.stdout:Install 8 Packages 2021-08-03T10:40:11.127 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:11.128 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 36 M 2021-08-03T10:40:11.128 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 197 M 2021-08-03T10:40:11.129 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:11.151 INFO:teuthology.orchestra.run.smithi003.stdout:(5/6): ceph-mgr-dashboard-17.0.0-6630.gdf0bf89f 5.2 MB/s | 1.5 MB 00:00 2021-08-03T10:40:11.158 INFO:teuthology.orchestra.run.smithi003.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.4 MB/s | 196 kB 00:00 2021-08-03T10:40:11.161 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:11.162 INFO:teuthology.orchestra.run.smithi003.stdout:Total 5.9 MB/s | 1.8 MB 00:00 2021-08-03T10:40:11.163 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:11.171 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:11.171 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:11.234 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:11.238 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:11.305 INFO:teuthology.orchestra.run.smithi101.stdout:(1/8): openblas-0.3.12-1.el8.x86_64.rpm 26 MB/s | 4.6 MB 00:00 2021-08-03T10:40:11.406 INFO:teuthology.orchestra.run.smithi101.stdout:(2/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2021-08-03T10:40:11.417 INFO:teuthology.orchestra.run.smithi101.stdout:(3/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 33 MB/s | 3.7 MB 00:00 2021-08-03T10:40:11.419 INFO:teuthology.orchestra.run.smithi101.stdout:(4/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 17 MB/s | 225 kB 00:00 2021-08-03T10:40:11.458 INFO:teuthology.orchestra.run.smithi101.stdout:(5/8): libgfortran-8.4.1-1.el8.x86_64.rpm 16 MB/s | 639 kB 00:00 2021-08-03T10:40:11.482 INFO:teuthology.orchestra.run.smithi101.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 7.0 MB/s | 169 kB 00:00 2021-08-03T10:40:11.493 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:11.677 INFO:teuthology.orchestra.run.smithi101.stdout:(7/8): ceph-mgr-diskprediction-local-17.0.0-663 13 MB/s | 7.4 MB 00:00 2021-08-03T10:40:11.706 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-08-03T10:40:11.783 INFO:teuthology.orchestra.run.smithi101.stdout:(8/8): python3-scipy-1.0.0-20.module_el8.4.0+79 40 MB/s | 15 MB 00:00 2021-08-03T10:40:11.787 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:11.787 INFO:teuthology.orchestra.run.smithi101.stdout:Total 54 MB/s | 36 MB 00:00 2021-08-03T10:40:11.796 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:11.815 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:11.815 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:11.942 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-08-03T10:40:12.148 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-08-03T10:40:12.176 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:12.179 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:12.262 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-6630.gdf0bf89f.el8.n 4/6 2021-08-03T10:40:12.687 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-6630.gdf0bf89f.el8. 5/6 2021-08-03T10:40:12.738 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:12.873 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-08-03T10:40:12.878 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarc 6/6 2021-08-03T10:40:13.007 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-08-03T10:40:13.144 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarc 6/6 2021-08-03T10:40:13.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-6630.gdf0bf89f.el8. 1/6 2021-08-03T10:40:13.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarc 2/6 2021-08-03T10:40:13.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-6630.gdf0bf89f.el8.n 3/6 2021-08-03T10:40:13.145 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-08-03T10:40:13.146 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-08-03T10:40:13.156 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-08-03T10:40:13.425 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-08-03T10:40:13.426 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:13.651 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:13.651 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:13.651 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:13.652 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:13.652 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:13.652 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-08-03T10:40:13.652 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-08-03T10:40:13.653 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.4.1-12.el8.noarch 2021-08-03T10:40:13.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:13.653 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:13.682 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-08-03T10:40:13.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-diskprediction-local 2021-08-03T10:40:13.881 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-08-03T10:40:14.310 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:28 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:14.428 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-08-03T10:40:14.598 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-08-03T10:40:15.270 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:===================================================================================================== 2021-08-03T10:40:15.271 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:40:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:===================================================================================================== 2021-08-03T10:40:15.271 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 7.4 M 2021-08-03T10:40:15.272 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:40:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-08-03T10:40:15.272 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-08-03T10:40:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-08-03T10:40:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-08-03T10:40:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-08-03T10:40:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-08-03T10:40:15.273 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-08-03T10:40:15.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:15.274 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:15.274 INFO:teuthology.orchestra.run.smithi003.stdout:===================================================================================================== 2021-08-03T10:40:15.275 INFO:teuthology.orchestra.run.smithi003.stdout:Install 8 Packages 2021-08-03T10:40:15.275 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:15.276 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 36 M 2021-08-03T10:40:15.276 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 197 M 2021-08-03T10:40:15.276 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:15.330 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-08-03T10:40:15.408 INFO:teuthology.orchestra.run.smithi003.stdout:(1/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2021-08-03T10:40:15.427 INFO:teuthology.orchestra.run.smithi003.stdout:(2/8): openblas-0.3.12-1.el8.x86_64.rpm 30 MB/s | 4.6 MB 00:00 2021-08-03T10:40:15.434 INFO:teuthology.orchestra.run.smithi003.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 32 MB/s | 225 kB 00:00 2021-08-03T10:40:15.489 INFO:teuthology.orchestra.run.smithi003.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 47 MB/s | 3.7 MB 00:00 2021-08-03T10:40:15.503 INFO:teuthology.orchestra.run.smithi003.stdout:(5/8): libgfortran-8.4.1-1.el8.x86_64.rpm 44 MB/s | 639 kB 00:00 2021-08-03T10:40:15.509 INFO:teuthology.orchestra.run.smithi003.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 30 MB/s | 169 kB 00:00 2021-08-03T10:40:15.697 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-08-03T10:40:15.710 INFO:teuthology.orchestra.run.smithi003.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.4.0+79 52 MB/s | 15 MB 00:00 2021-08-03T10:40:15.899 INFO:teuthology.orchestra.run.smithi003.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-663 12 MB/s | 7.4 MB 00:00 2021-08-03T10:40:15.902 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:15.903 INFO:teuthology.orchestra.run.smithi003.stdout:Total 57 MB/s | 36 MB 00:00 2021-08-03T10:40:15.912 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:15.923 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-08-03T10:40:15.932 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:15.933 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:16.304 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:16.307 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:16.889 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:17.081 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-08-03T10:40:17.206 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-08-03T10:40:17.345 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-08-03T10:40:17.903 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-08-03T10:40:17.912 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-08-03T10:40:18.095 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-08-03T10:40:18.699 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-08-03T10:40:18.886 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-08-03T10:40:19.163 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-08-03T10:40:19.380 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89 8/8 2021-08-03T10:40:19.649 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89 8/8 2021-08-03T10:40:19.649 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89 1/8 2021-08-03T10:40:19.650 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-08-03T10:40:19.650 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-08-03T10:40:19.650 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-08-03T10:40:19.650 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-08-03T10:40:19.650 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-08-03T10:40:19.651 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-08-03T10:40:19.657 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-08-03T10:40:19.955 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-08-03T10:40:19.956 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:20.026 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-08-03T10:40:20.244 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-08-03T10:40:20.688 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:20.689 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:20.689 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:20.689 INFO:teuthology.orchestra.run.smithi101.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-08-03T10:40:20.690 INFO:teuthology.orchestra.run.smithi101.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-08-03T10:40:20.690 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-0.3.12-1.el8.x86_64 2021-08-03T10:40:20.690 INFO:teuthology.orchestra.run.smithi101.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-08-03T10:40:20.690 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-08-03T10:40:20.691 INFO:teuthology.orchestra.run.smithi101.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-08-03T10:40:20.691 INFO:teuthology.orchestra.run.smithi101.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-08-03T10:40:20.691 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:20.691 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:21.518 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mgr-rook 2021-08-03T10:40:22.068 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:37 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:22.375 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-08-03T10:40:22.952 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:22.954 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================== 2021-08-03T10:40:22.954 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:40:22.955 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================== 2021-08-03T10:40:22.956 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:22.956 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-rook noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 41 k 2021-08-03T10:40:22.957 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:40:22.957 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-08-03T10:40:22.957 INFO:teuthology.orchestra.run.smithi101.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-08-03T10:40:22.958 INFO:teuthology.orchestra.run.smithi101.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-08-03T10:40:22.958 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-08-03T10:40:22.959 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-08-03T10:40:22.960 INFO:teuthology.orchestra.run.smithi101.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-08-03T10:40:22.960 INFO:teuthology.orchestra.run.smithi101.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-08-03T10:40:22.961 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-08-03T10:40:22.961 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-08-03T10:40:22.961 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-08-03T10:40:22.962 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-08-03T10:40:22.962 INFO:teuthology.orchestra.run.smithi101.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-08-03T10:40:22.963 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:22.963 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:22.964 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================== 2021-08-03T10:40:22.964 INFO:teuthology.orchestra.run.smithi101.stdout:Install 13 Packages 2021-08-03T10:40:22.964 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:22.966 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 1.9 M 2021-08-03T10:40:22.967 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 25 M 2021-08-03T10:40:22.967 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:22.988 INFO:teuthology.orchestra.run.smithi101.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 853 kB/s | 27 kB 00:00 2021-08-03T10:40:22.991 INFO:teuthology.orchestra.run.smithi101.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 51 MB/s | 126 kB 00:00 2021-08-03T10:40:22.991 INFO:teuthology.orchestra.run.smithi101.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 588 kB/s | 20 kB 00:00 2021-08-03T10:40:22.993 INFO:teuthology.orchestra.run.smithi101.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 44 MB/s | 110 kB 00:00 2021-08-03T10:40:22.995 INFO:teuthology.orchestra.run.smithi101.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 40 MB/s | 155 kB 00:00 2021-08-03T10:40:22.996 INFO:teuthology.orchestra.run.smithi101.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 21 MB/s | 43 kB 00:00 2021-08-03T10:40:23.060 INFO:teuthology.orchestra.run.smithi101.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 509 kB/s | 33 kB 00:00 2021-08-03T10:40:23.062 INFO:teuthology.orchestra.run.smithi101.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 245 kB/s | 16 kB 00:00 2021-08-03T10:40:23.103 INFO:teuthology.orchestra.run.smithi101.stdout:(9/13): ceph-mgr-rook-17.0.0-6630.gdf0bf89f.el8 280 kB/s | 41 kB 00:00 2021-08-03T10:40:23.104 INFO:teuthology.orchestra.run.smithi101.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.9 MB/s | 81 kB 00:00 2021-08-03T10:40:23.126 INFO:teuthology.orchestra.run.smithi101.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.7 MB/s | 61 kB 00:00 2021-08-03T10:40:23.240 INFO:teuthology.orchestra.run.smithi101.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 6.6 MB/s | 1.2 MB 00:00 2021-08-03T10:40:23.674 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-08-03T10:40:23.852 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89 8/8 2021-08-03T10:40:23.968 INFO:teuthology.orchestra.run.smithi101.stdout:(13/13): python3-rsa-3.4.2-16.el8.noarch.rpm 85 kB/s | 73 kB 00:00 2021-08-03T10:40:23.970 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:23.971 INFO:teuthology.orchestra.run.smithi101.stdout:Total 1.9 MB/s | 1.9 MB 00:01 2021-08-03T10:40:23.977 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:23.992 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:23.993 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:24.072 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:24.075 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:24.154 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89 8/8 2021-08-03T10:40:24.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89 1/8 2021-08-03T10:40:24.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-08-03T10:40:24.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-08-03T10:40:24.155 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-08-03T10:40:24.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-08-03T10:40:24.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-08-03T10:40:24.156 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-08-03T10:40:24.458 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-08-03T10:40:24.458 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:24.590 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:24.852 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-08-03T10:40:25.061 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-08-03T10:40:25.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:25.218 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:25.218 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:25.218 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-08-03T10:40:25.218 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-08-03T10:40:25.219 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.12-1.el8.x86_64 2021-08-03T10:40:25.219 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-08-03T10:40:25.219 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-08-03T10:40:25.219 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-08-03T10:40:25.220 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-08-03T10:40:25.220 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:25.220 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:25.325 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-08-03T10:40:25.525 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-08-03T10:40:25.728 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-08-03T10:40:25.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-rook 2021-08-03T10:40:25.946 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-08-03T10:40:26.222 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-08-03T10:40:26.387 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:40 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:26.453 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-08-03T10:40:27.355 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:27.357 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-08-03T10:40:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:40:27.357 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-08-03T10:40:27.358 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 41 k 2021-08-03T10:40:27.358 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:40:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-08-03T10:40:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-08-03T10:40:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-08-03T10:40:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-08-03T10:40:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-08-03T10:40:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-08-03T10:40:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-08-03T10:40:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-08-03T10:40:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-08-03T10:40:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-08-03T10:40:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-08-03T10:40:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-08-03T10:40:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:27.361 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:27.362 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-08-03T10:40:27.362 INFO:teuthology.orchestra.run.smithi003.stdout:Install 13 Packages 2021-08-03T10:40:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:27.364 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 1.9 M 2021-08-03T10:40:27.364 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 25 M 2021-08-03T10:40:27.364 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:27.393 INFO:teuthology.orchestra.run.smithi003.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 830 kB/s | 27 kB 00:00 2021-08-03T10:40:27.395 INFO:teuthology.orchestra.run.smithi003.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 47 MB/s | 126 kB 00:00 2021-08-03T10:40:27.396 INFO:teuthology.orchestra.run.smithi003.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 564 kB/s | 20 kB 00:00 2021-08-03T10:40:27.398 INFO:teuthology.orchestra.run.smithi003.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 40 MB/s | 110 kB 00:00 2021-08-03T10:40:27.400 INFO:teuthology.orchestra.run.smithi003.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 42 MB/s | 155 kB 00:00 2021-08-03T10:40:27.400 INFO:teuthology.orchestra.run.smithi003.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 23 MB/s | 43 kB 00:00 2021-08-03T10:40:27.479 INFO:teuthology.orchestra.run.smithi003.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 418 kB/s | 33 kB 00:00 2021-08-03T10:40:27.481 INFO:teuthology.orchestra.run.smithi003.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 203 kB/s | 16 kB 00:00 2021-08-03T10:40:27.506 INFO:teuthology.orchestra.run.smithi003.stdout:(9/13): ceph-mgr-rook-17.0.0-6630.gdf0bf89f.el8 280 kB/s | 41 kB 00:00 2021-08-03T10:40:27.531 INFO:teuthology.orchestra.run.smithi003.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.5 MB/s | 81 kB 00:00 2021-08-03T10:40:27.558 INFO:teuthology.orchestra.run.smithi003.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.2 MB/s | 61 kB 00:00 2021-08-03T10:40:27.568 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-08-03T10:40:27.613 INFO:teuthology.orchestra.run.smithi003.stdout:(12/13): python3-rsa-3.4.2-16.el8.noarch.rpm 685 kB/s | 73 kB 00:00 2021-08-03T10:40:27.696 INFO:teuthology.orchestra.run.smithi003.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.4 MB/s | 1.2 MB 00:00 2021-08-03T10:40:27.698 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:27.698 INFO:teuthology.orchestra.run.smithi003.stdout:Total 5.7 MB/s | 1.9 MB 00:00 2021-08-03T10:40:27.704 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:27.719 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:27.719 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:27.801 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:27.804 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:27.845 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-08-03T10:40:28.020 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-08-03T10:40:28.264 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-08-03T10:40:28.316 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:28.446 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 13/13 2021-08-03T10:40:28.551 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-08-03T10:40:28.697 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 13/13 2021-08-03T10:40:28.697 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/13 2021-08-03T10:40:28.698 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-08-03T10:40:28.698 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-08-03T10:40:28.698 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-08-03T10:40:28.698 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-08-03T10:40:28.699 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-08-03T10:40:28.699 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-08-03T10:40:28.699 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-08-03T10:40:28.699 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-08-03T10:40:28.700 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-08-03T10:40:28.700 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-08-03T10:40:28.700 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-08-03T10:40:28.787 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-08-03T10:40:29.014 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-08-03T10:40:29.015 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:29.033 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-08-03T10:40:29.236 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:29.237 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:29.237 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:29.237 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-08-03T10:40:29.238 INFO:teuthology.orchestra.run.smithi101.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-08-03T10:40:29.238 INFO:teuthology.orchestra.run.smithi101.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-08-03T10:40:29.238 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-08-03T10:40:29.238 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-08-03T10:40:29.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-08-03T10:40:29.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-08-03T10:40:29.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-08-03T10:40:29.239 INFO:teuthology.orchestra.run.smithi101.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-08-03T10:40:29.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-08-03T10:40:29.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-08-03T10:40:29.240 INFO:teuthology.orchestra.run.smithi101.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-08-03T10:40:29.240 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:29.241 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:29.251 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-08-03T10:40:29.345 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mgr-cephadm 2021-08-03T10:40:29.445 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-08-03T10:40:29.649 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-08-03T10:40:29.895 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:44 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:29.951 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-08-03T10:40:30.161 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-08-03T10:40:30.795 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:30.796 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:30.796 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:40:30.796 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:30.797 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:30.797 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-cephadm noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 90 k 2021-08-03T10:40:30.797 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:40:30.797 INFO:teuthology.orchestra.run.smithi101.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-08-03T10:40:30.797 INFO:teuthology.orchestra.run.smithi101.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-08-03T10:40:30.798 INFO:teuthology.orchestra.run.smithi101.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-08-03T10:40:30.798 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-08-03T10:40:30.798 INFO:teuthology.orchestra.run.smithi101.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-08-03T10:40:30.799 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:30.799 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:30.799 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:30.799 INFO:teuthology.orchestra.run.smithi101.stdout:Install 6 Packages 2021-08-03T10:40:30.799 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:30.800 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 5.8 M 2021-08-03T10:40:30.800 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 24 M 2021-08-03T10:40:30.801 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:30.846 INFO:teuthology.orchestra.run.smithi101.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2021-08-03T10:40:30.892 INFO:teuthology.orchestra.run.smithi101.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 51 MB/s | 4.8 MB 00:00 2021-08-03T10:40:30.926 INFO:teuthology.orchestra.run.smithi101.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 264 kB/s | 21 kB 00:00 2021-08-03T10:40:30.967 INFO:teuthology.orchestra.run.smithi101.stdout:(4/6): ceph-mgr-cephadm-17.0.0-6630.gdf0bf89f.e 533 kB/s | 90 kB 00:00 2021-08-03T10:40:30.980 INFO:teuthology.orchestra.run.smithi101.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 889 kB/s | 48 kB 00:00 2021-08-03T10:40:31.020 INFO:teuthology.orchestra.run.smithi101.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.7 MB/s | 355 kB 00:00 2021-08-03T10:40:31.022 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:31.023 INFO:teuthology.orchestra.run.smithi101.stdout:Total 26 MB/s | 5.8 MB 00:00 2021-08-03T10:40:31.025 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:31.034 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:31.034 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:31.114 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:31.117 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-08-03T10:40:31.386 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:31.600 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-08-03T10:40:31.641 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-08-03T10:40:31.776 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-08-03T10:40:31.971 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-08-03T10:40:32.168 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 13/13 2021-08-03T10:40:32.382 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-08-03T10:40:32.434 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 13/13 2021-08-03T10:40:32.435 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/13 2021-08-03T10:40:32.435 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-08-03T10:40:32.436 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-08-03T10:40:32.436 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-08-03T10:40:32.437 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-08-03T10:40:32.437 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-08-03T10:40:32.437 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-08-03T10:40:32.438 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-08-03T10:40:32.438 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-08-03T10:40:32.439 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-08-03T10:40:32.439 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-08-03T10:40:32.439 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-08-03T10:40:32.774 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-08-03T10:40:32.775 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:33.006 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:33.006 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:33.006 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:33.007 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-08-03T10:40:33.007 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-08-03T10:40:33.007 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-08-03T10:40:33.008 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-08-03T10:40:33.008 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-08-03T10:40:33.008 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-08-03T10:40:33.009 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-08-03T10:40:33.010 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-08-03T10:40:33.010 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-08-03T10:40:33.010 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-08-03T10:40:33.010 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-08-03T10:40:33.011 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-08-03T10:40:33.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:33.011 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:33.117 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-cephadm 2021-08-03T10:40:33.480 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-08-03T10:40:33.702 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:47 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:33.855 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-08-03T10:40:34.103 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-08-03T10:40:34.328 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 6/6 2021-08-03T10:40:34.561 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 6/6 2021-08-03T10:40:34.561 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/6 2021-08-03T10:40:34.561 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-08-03T10:40:34.561 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-08-03T10:40:34.562 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-08-03T10:40:34.562 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-08-03T10:40:34.668 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:34.669 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:34.669 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:40:34.669 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:34.670 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:34.670 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:17.0.0-6630.gdf0bf89f.el8 ceph-noarch 90 k 2021-08-03T10:40:34.670 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:40:34.670 INFO:teuthology.orchestra.run.smithi003.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-08-03T10:40:34.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-08-03T10:40:34.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-08-03T10:40:34.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-08-03T10:40:34.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-08-03T10:40:34.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:34.672 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:34.672 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:34.673 INFO:teuthology.orchestra.run.smithi003.stdout:Install 6 Packages 2021-08-03T10:40:34.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:34.674 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 5.8 M 2021-08-03T10:40:34.674 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 24 M 2021-08-03T10:40:34.674 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:34.729 INFO:teuthology.orchestra.run.smithi003.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 9.2 MB/s | 538 kB 00:00 2021-08-03T10:40:34.785 INFO:teuthology.orchestra.run.smithi003.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 42 MB/s | 4.8 MB 00:00 2021-08-03T10:40:34.809 INFO:teuthology.orchestra.run.smithi003.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 263 kB/s | 21 kB 00:00 2021-08-03T10:40:34.818 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-08-03T10:40:34.818 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:34.863 INFO:teuthology.orchestra.run.smithi003.stdout:(4/6): python3-remoto-1.1.4-4.el8.noarch.rpm 891 kB/s | 48 kB 00:00 2021-08-03T10:40:34.918 INFO:teuthology.orchestra.run.smithi003.stdout:(5/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.6 MB/s | 355 kB 00:00 2021-08-03T10:40:34.968 INFO:teuthology.orchestra.run.smithi003.stdout:(6/6): ceph-mgr-cephadm-17.0.0-6630.gdf0bf89f.e 303 kB/s | 90 kB 00:00 2021-08-03T10:40:34.970 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:34.971 INFO:teuthology.orchestra.run.smithi003.stdout:Total 19 MB/s | 5.8 MB 00:00 2021-08-03T10:40:34.974 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:34.983 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:34.984 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:35.048 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:35.049 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:35.049 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:35.049 INFO:teuthology.orchestra.run.smithi101.stdout: python3-apipkg-1.5-6.el8.noarch 2021-08-03T10:40:35.050 INFO:teuthology.orchestra.run.smithi101.stdout: python3-babel-2.5.1-5.el8.noarch 2021-08-03T10:40:35.050 INFO:teuthology.orchestra.run.smithi101.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-08-03T10:40:35.050 INFO:teuthology.orchestra.run.smithi101.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-08-03T10:40:35.050 INFO:teuthology.orchestra.run.smithi101.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-08-03T10:40:35.050 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:35.051 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:35.070 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:35.073 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:35.119 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-fuse 2021-08-03T10:40:35.341 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:35.634 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-08-03T10:40:35.674 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:50 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:35.883 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-08-03T10:40:36.574 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:36.576 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:36.576 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repository Size 2021-08-03T10:40:36.577 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:36.577 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:36.577 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 820 k 2021-08-03T10:40:36.578 INFO:teuthology.orchestra.run.smithi101.stdout:Installing dependencies: 2021-08-03T10:40:36.578 INFO:teuthology.orchestra.run.smithi101.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-08-03T10:40:36.578 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:36.579 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:36.579 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:36.579 INFO:teuthology.orchestra.run.smithi101.stdout:Install 2 Packages 2021-08-03T10:40:36.580 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:36.580 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 902 k 2021-08-03T10:40:36.581 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 3.3 M 2021-08-03T10:40:36.581 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:36.609 INFO:teuthology.orchestra.run.smithi101.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 82 kB 00:00 2021-08-03T10:40:36.799 INFO:teuthology.orchestra.run.smithi101.stdout:(2/2): ceph-fuse-17.0.0-6630.gdf0bf89f.el8.x86_ 3.6 MB/s | 820 kB 00:00 2021-08-03T10:40:36.800 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:36.801 INFO:teuthology.orchestra.run.smithi101.stdout:Total 3.9 MB/s | 902 kB 00:00 2021-08-03T10:40:36.802 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:36.823 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:36.823 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:36.889 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-08-03T10:40:36.900 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:36.903 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:37.066 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:37.244 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-08-03T10:40:37.384 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-08-03T10:40:37.484 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-08-03T10:40:37.594 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/2 2021-08-03T10:40:37.683 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 6/6 2021-08-03T10:40:37.937 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 6/6 2021-08-03T10:40:37.937 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 1/6 2021-08-03T10:40:37.938 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-08-03T10:40:37.939 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-08-03T10:40:37.939 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-08-03T10:40:37.939 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-08-03T10:40:37.948 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/2 2021-08-03T10:40:37.948 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/2 2021-08-03T10:40:38.200 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-08-03T10:40:38.201 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:38.210 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-08-03T10:40:38.211 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:38.435 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:38.435 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:38.435 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-08-03T10:40:38.435 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:38.436 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:38.457 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:38.457 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:38.457 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:17.0.0-6630.gdf0bf89f.el8.noarch 2021-08-03T10:40:38.458 INFO:teuthology.orchestra.run.smithi003.stdout: python3-apipkg-1.5-6.el8.noarch 2021-08-03T10:40:38.458 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.5.1-5.el8.noarch 2021-08-03T10:40:38.458 INFO:teuthology.orchestra.run.smithi003.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-08-03T10:40:38.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-08-03T10:40:38.459 INFO:teuthology.orchestra.run.smithi003.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-08-03T10:40:38.459 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:38.459 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:38.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-fuse 2021-08-03T10:40:38.614 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install librados-devel 2021-08-03T10:40:39.136 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:53 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:39.178 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:54 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:40.081 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:40.083 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:40.083 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:40:40.084 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:40.084 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:40.084 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 125 k 2021-08-03T10:40:40.085 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:40.085 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:40.086 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:40.086 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:40:40.087 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:40.087 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 125 k 2021-08-03T10:40:40.088 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 432 k 2021-08-03T10:40:40.088 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:40.097 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:40.099 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:40.099 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2021-08-03T10:40:40.100 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:40.100 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:40.100 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 820 k 2021-08-03T10:40:40.101 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2021-08-03T10:40:40.101 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-08-03T10:40:40.102 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:40.102 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:40.102 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:40.103 INFO:teuthology.orchestra.run.smithi003.stdout:Install 2 Packages 2021-08-03T10:40:40.103 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:40.104 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 902 k 2021-08-03T10:40:40.104 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 3.3 M 2021-08-03T10:40:40.104 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:40.132 INFO:teuthology.orchestra.run.smithi003.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 82 kB 00:00 2021-08-03T10:40:40.251 INFO:teuthology.orchestra.run.smithi101.stdout:librados-devel-17.0.0-6630.gdf0bf89f.el8.x86_64 743 kB/s | 125 kB 00:00 2021-08-03T10:40:40.252 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:40.253 INFO:teuthology.orchestra.run.smithi101.stdout:Total 737 kB/s | 125 kB 00:00 2021-08-03T10:40:40.253 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:40.259 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:40.259 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:40.309 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:40.313 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:40.319 INFO:teuthology.orchestra.run.smithi003.stdout:(2/2): ceph-fuse-17.0.0-6630.gdf0bf89f.el8.x86_ 3.6 MB/s | 820 kB 00:00 2021-08-03T10:40:40.321 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:40.321 INFO:teuthology.orchestra.run.smithi003.stdout:Total 4.0 MB/s | 902 kB 00:00 2021-08-03T10:40:40.322 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:40.345 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:40.346 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:40.419 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:40.433 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:40.437 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:40.643 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:40.883 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-08-03T10:40:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/2 2021-08-03T10:40:41.132 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:41.132 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:41.359 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:41.359 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:41.359 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:40:41.360 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:41.360 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2/2 2021-08-03T10:40:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/2 2021-08-03T10:40:41.531 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install libcephfs2 2021-08-03T10:40:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-08-03T10:40:41.719 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:42.095 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:57 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:42.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:42.257 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:42.257 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-08-03T10:40:42.257 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:42.257 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:42.529 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados-devel 2021-08-03T10:40:42.794 INFO:teuthology.orchestra.run.smithi101.stdout:Package libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:43.021 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:43.022 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:43.022 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:43.091 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install libcephfs-devel 2021-08-03T10:40:43.124 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:57 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:43.648 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:01:58 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:44.082 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:44.083 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:44.083 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:40:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:44.084 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 125 k 2021-08-03T10:40:44.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:44.084 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:40:44.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:44.085 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 125 k 2021-08-03T10:40:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 432 k 2021-08-03T10:40:44.086 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:44.255 INFO:teuthology.orchestra.run.smithi003.stdout:librados-devel-17.0.0-6630.gdf0bf89f.el8.x86_64 733 kB/s | 125 kB 00:00 2021-08-03T10:40:44.255 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:44.256 INFO:teuthology.orchestra.run.smithi003.stdout:Total 727 kB/s | 125 kB 00:00 2021-08-03T10:40:44.257 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:44.262 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:44.263 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:44.317 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:44.321 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:44.434 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:44.563 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:44.564 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:44.564 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:40:44.564 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:44.565 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:44.565 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs-devel x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 24 k 2021-08-03T10:40:44.565 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:44.565 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:44.566 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:44.566 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:40:44.566 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:44.566 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 24 k 2021-08-03T10:40:44.566 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 102 k 2021-08-03T10:40:44.567 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:44.631 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:44.689 INFO:teuthology.orchestra.run.smithi101.stdout:libcephfs-devel-17.0.0-6630.gdf0bf89f.el8.x86_6 193 kB/s | 24 kB 00:00 2021-08-03T10:40:44.689 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:44.690 INFO:teuthology.orchestra.run.smithi101.stdout:Total 191 kB/s | 24 kB 00:00 2021-08-03T10:40:44.690 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:44.693 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:44.693 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:44.694 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:44.698 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:44.752 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:44.874 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:44.917 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:45.131 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:45.131 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:45.136 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:45.362 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:45.363 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:45.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:45.386 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:40:45.387 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:45.568 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs2 2021-08-03T10:40:45.583 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:45.583 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:45.583 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:40:45.583 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:45.584 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:45.653 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install librados2 2021-08-03T10:40:46.159 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:00 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:46.203 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:01 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:46.864 INFO:teuthology.orchestra.run.smithi003.stdout:Package libcephfs2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:46.902 INFO:teuthology.orchestra.run.smithi101.stdout:Package librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:47.103 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:47.104 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:47.104 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:47.136 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:47.137 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:47.137 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:47.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs-devel 2021-08-03T10:40:47.199 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install librbd1 2021-08-03T10:40:47.750 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:02 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:47.788 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:01 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:48.738 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:48.739 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:40:48.740 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:48.740 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:40:48.740 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 24 k 2021-08-03T10:40:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:48.741 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:40:48.741 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:40:48.741 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:40:48.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:48.742 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 24 k 2021-08-03T10:40:48.742 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 102 k 2021-08-03T10:40:48.742 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:40:48.864 INFO:teuthology.orchestra.run.smithi003.stdout:libcephfs-devel-17.0.0-6630.gdf0bf89f.el8.x86_6 193 kB/s | 24 kB 00:00 2021-08-03T10:40:48.865 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:48.865 INFO:teuthology.orchestra.run.smithi003.stdout:Total 191 kB/s | 24 kB 00:00 2021-08-03T10:40:48.865 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:40:48.868 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:40:48.869 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:40:48.870 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:40:48.874 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:40:48.879 INFO:teuthology.orchestra.run.smithi101.stdout:Package librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:48.929 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:40:49.114 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:49.115 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:49.115 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:49.130 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:49.357 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:49.527 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-rados 2021-08-03T10:40:49.631 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:49.631 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:40:49.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:49.866 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:40:49.867 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:40:49.867 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:40:49.867 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:49.956 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados2 2021-08-03T10:40:50.081 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:05 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:50.543 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:04 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:50.801 INFO:teuthology.orchestra.run.smithi101.stdout:Package python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:51.034 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:51.035 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:51.035 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:51.150 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-rgw 2021-08-03T10:40:51.255 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:51.503 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:51.504 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:51.504 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:51.586 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librbd1 2021-08-03T10:40:51.703 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:06 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:52.173 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:06 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:52.384 INFO:teuthology.orchestra.run.smithi101.stdout:Package python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:52.619 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:52.619 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:52.620 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:52.682 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-cephfs 2021-08-03T10:40:52.921 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:53.163 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:53.164 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:53.165 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:53.235 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:08 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:53.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rados 2021-08-03T10:40:53.918 INFO:teuthology.orchestra.run.smithi101.stdout:Package python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:53.977 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:07 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:54.148 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:54.149 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:54.149 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:54.220 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-rbd 2021-08-03T10:40:54.738 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rados-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:54.776 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:09 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:54.986 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:54.987 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:54.988 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:55.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rgw 2021-08-03T10:40:55.551 INFO:teuthology.orchestra.run.smithi101.stdout:Package python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:55.658 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:09 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:55.788 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:55.789 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:40:55.789 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:55.855 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install rbd-fuse 2021-08-03T10:40:56.408 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:11 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:56.409 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rgw-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:56.664 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:56.665 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:56.665 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:56.752 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-cephfs 2021-08-03T10:40:57.314 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:40:57.315 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:57.315 INFO:teuthology.orchestra.run.smithi101.stdout: Package Architecture Version Repository Size 2021-08-03T10:40:57.315 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:57.315 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:40:57.316 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 85 k 2021-08-03T10:40:57.316 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:57.316 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:40:57.316 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:40:57.317 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:40:57.317 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:57.317 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 85 k 2021-08-03T10:40:57.317 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 284 k 2021-08-03T10:40:57.318 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:40:57.342 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:11 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:57.463 INFO:teuthology.orchestra.run.smithi101.stdout:rbd-fuse-17.0.0-6630.gdf0bf89f.el8.x86_64.rpm 575 kB/s | 85 kB 00:00 2021-08-03T10:40:57.464 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:40:57.464 INFO:teuthology.orchestra.run.smithi101.stdout:Total 570 kB/s | 85 kB 00:00 2021-08-03T10:40:57.464 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:40:57.474 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:40:57.475 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:40:57.526 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:40:57.529 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:40:57.639 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:40:57.849 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:58.048 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-cephfs-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:58.085 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:58.288 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:58.289 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:58.290 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:40:58.335 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:40:58.336 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:40:58.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rbd 2021-08-03T10:40:58.574 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:58.574 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:40:58.574 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:40:58.574 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:40:58.575 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:40:58.764 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install rbd-mirror 2021-08-03T10:40:58.956 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:12 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:40:59.325 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:14 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:40:59.670 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:40:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:40:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:40:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:41:00.009 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-fuse 2021-08-03T10:41:00.238 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:41:00.239 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:00.239 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:41:00.240 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:00.240 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:41:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.5 M 2021-08-03T10:41:00.240 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:00.241 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:41:00.241 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:00.241 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:41:00.241 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:00.242 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 3.5 M 2021-08-03T10:41:00.242 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 20 M 2021-08-03T10:41:00.242 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:41:00.576 INFO:teuthology.orchestra.run.smithi101.stdout:rbd-mirror-17.0.0-6630.gdf0bf89f.el8.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2021-08-03T10:41:00.577 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:41:00.578 INFO:teuthology.orchestra.run.smithi101.stdout:Total 10 MB/s | 3.5 MB 00:00 2021-08-03T10:41:00.578 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:41:00.591 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:41:00.591 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:41:00.593 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:14 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:41:00.654 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:41:00.657 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:41:01.286 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:41:01.475 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:01.543 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:41:01.544 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:01.544 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2021-08-03T10:41:01.545 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:01.545 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:41:01.545 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 85 k 2021-08-03T10:41:01.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:01.546 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:41:01.546 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:01.546 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:41:01.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:01.547 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 85 k 2021-08-03T10:41:01.547 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 284 k 2021-08-03T10:41:01.547 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:41:01.695 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-fuse-17.0.0-6630.gdf0bf89f.el8.x86_64.rpm 563 kB/s | 85 kB 00:00 2021-08-03T10:41:01.696 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:41:01.696 INFO:teuthology.orchestra.run.smithi003.stdout:Total 558 kB/s | 85 kB 00:00 2021-08-03T10:41:01.697 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:41:01.708 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:41:01.708 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:41:01.762 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:41:01.766 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:41:01.870 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:01.875 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:41:02.096 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:02.115 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:02.115 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:41:02.378 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:02.390 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:02.390 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:41:02.390 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:41:02.390 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:02.391 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:41:02.571 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install rbd-nbd 2021-08-03T10:41:02.630 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:02.631 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:41:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:41:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:41:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:41:03.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-mirror 2021-08-03T10:41:03.131 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:18 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:41:03.691 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:17 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:41:04.047 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:41:04.047 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:04.047 INFO:teuthology.orchestra.run.smithi101.stdout: Package Architecture Version Repository Size 2021-08-03T10:41:04.048 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:04.048 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:41:04.048 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 163 k 2021-08-03T10:41:04.048 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:04.049 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:41:04.049 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:04.049 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:41:04.049 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:04.050 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 163 k 2021-08-03T10:41:04.050 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 595 k 2021-08-03T10:41:04.050 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:41:04.529 INFO:teuthology.orchestra.run.smithi101.stdout:rbd-nbd-17.0.0-6630.gdf0bf89f.el8.x86_64.rpm 339 kB/s | 163 kB 00:00 2021-08-03T10:41:04.530 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:41:04.530 INFO:teuthology.orchestra.run.smithi101.stdout:Total 338 kB/s | 163 kB 00:00 2021-08-03T10:41:04.531 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:41:04.542 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:41:04.543 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:41:04.594 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:41:04.597 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:41:04.713 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:41:04.790 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:41:04.791 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:04.791 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:41:04.791 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:04.792 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:41:04.792 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.5 M 2021-08-03T10:41:04.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:04.792 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:41:04.793 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:04.793 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:41:04.793 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:04.793 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 3.5 M 2021-08-03T10:41:04.793 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 20 M 2021-08-03T10:41:04.794 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:41:04.890 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:05.158 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:05.391 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:05.391 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:41:05.623 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:05.623 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:41:05.624 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:41:05.624 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:05.624 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:41:05.753 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-mirror-17.0.0-6630.gdf0bf89f.el8.x86_64.rpm 3.7 MB/s | 3.5 MB 00:00 2021-08-03T10:41:05.754 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:41:05.755 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.7 MB/s | 3.5 MB 00:00 2021-08-03T10:41:05.756 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:41:05.771 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:41:05.772 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:41:05.820 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-base-debuginfo 2021-08-03T10:41:05.844 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:41:05.847 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:41:06.353 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:41:06.462 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:21 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:41:06.562 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:06.953 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:07.193 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:07.193 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:41:07.370 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:41:07.371 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:07.372 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:41:07.372 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:07.372 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:41:07.372 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 96 M 2021-08-03T10:41:07.373 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:07.373 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:41:07.373 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:07.373 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:41:07.374 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:07.374 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 96 M 2021-08-03T10:41:07.374 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 714 M 2021-08-03T10:41:07.374 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:41:07.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:07.487 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:41:07.487 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:41:07.487 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:07.487 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:41:07.678 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-nbd 2021-08-03T10:41:08.270 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:22 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:41:09.373 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:41:09.374 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:09.374 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2021-08-03T10:41:09.375 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:09.375 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:41:09.375 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 163 k 2021-08-03T10:41:09.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:09.376 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:41:09.376 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:09.376 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:41:09.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:09.376 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 163 k 2021-08-03T10:41:09.377 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 595 k 2021-08-03T10:41:09.377 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:41:09.853 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-nbd-17.0.0-6630.gdf0bf89f.el8.x86_64.rpm 342 kB/s | 163 kB 00:00 2021-08-03T10:41:09.854 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:41:09.854 INFO:teuthology.orchestra.run.smithi003.stdout:Total 341 kB/s | 163 kB 00:00 2021-08-03T10:41:09.855 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:41:09.868 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:41:09.868 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:41:09.925 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:41:09.928 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:41:10.052 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:41:10.427 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:10.690 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:10.947 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:41:10.947 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:41:11.222 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:11.222 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:41:11.222 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:41:11.223 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:11.223 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:41:11.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-base-debuginfo 2021-08-03T10:41:11.971 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:25 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:41:12.749 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-base-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 18 MB/s | 96 MB 00:05 2021-08-03T10:41:12.751 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:41:12.751 INFO:teuthology.orchestra.run.smithi101.stdout:Total 18 MB/s | 96 MB 00:05 2021-08-03T10:41:12.752 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:41:12.756 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:41:12.756 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:41:12.922 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:41:12.923 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:12.924 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:41:12.924 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:12.924 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:41:12.925 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 96 M 2021-08-03T10:41:12.925 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:12.925 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:41:12.925 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:12.925 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:41:12.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:12.926 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 96 M 2021-08-03T10:41:12.926 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 714 M 2021-08-03T10:41:12.926 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:41:13.172 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:41:13.175 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:41:19.413 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-base-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 15 MB/s | 96 MB 00:06 2021-08-03T10:41:19.414 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:41:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:Total 15 MB/s | 96 MB 00:06 2021-08-03T10:41:19.415 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:41:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:41:19.420 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:41:19.853 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:41:19.856 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:41:25.075 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:41:25.325 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:41:25.543 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:41:25.775 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:41:25.776 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:41:26.011 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:26.011 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:41:26.011 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:41:26.012 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:26.012 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:41:26.088 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-common-debuginfo 2021-08-03T10:41:26.641 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:02:41 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:41:27.636 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:41:27.638 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:27.638 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:41:27.639 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:27.639 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:41:27.639 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 634 M 2021-08-03T10:41:27.640 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:27.640 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:41:27.641 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:41:27.641 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:41:27.641 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:41:27.642 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 634 M 2021-08-03T10:41:27.642 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 3.3 G 2021-08-03T10:41:27.642 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:41:32.571 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:41:32.848 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:41:33.082 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:41:33.326 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:41:33.326 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:41:33.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:33.572 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:41:33.572 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:41:33.572 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:33.572 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:41:33.669 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-common-debuginfo 2021-08-03T10:41:34.260 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:48 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:41:35.232 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:41:35.233 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:35.233 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:41:35.233 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:35.233 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:41:35.234 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 634 M 2021-08-03T10:41:35.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:35.234 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:41:35.234 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:41:35.234 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:41:35.235 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:41:35.235 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 634 M 2021-08-03T10:41:35.235 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 3.3 G 2021-08-03T10:41:35.235 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:42:39.039 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-common-debuginfo-17.0.0-6630.gdf0bf89f.el8 8.9 MB/s | 634 MB 01:11 2021-08-03T10:42:39.040 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:42:39.040 INFO:teuthology.orchestra.run.smithi101.stdout:Total 8.9 MB/s | 634 MB 01:11 2021-08-03T10:42:39.040 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:42:39.043 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:42:39.043 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:42:41.438 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:42:41.442 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:42:47.507 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-common-debuginfo-17.0.0-6630.gdf0bf89f.el8 8.8 MB/s | 634 MB 01:12 2021-08-03T10:42:47.508 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:42:47.509 INFO:teuthology.orchestra.run.smithi003.stdout:Total 8.8 MB/s | 634 MB 01:12 2021-08-03T10:42:47.509 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:42:47.513 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:42:47.513 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:42:50.030 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:42:50.034 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:43:49.921 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:43:50.147 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:43:50.366 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:43:50.596 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:43:50.596 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:43:50.816 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:50.817 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:43:50.817 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:43:50.817 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:50.817 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:43:50.949 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2021-08-03T10:43:51.503 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:05:06 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:43:52.401 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:43:52.536 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================== 2021-08-03T10:43:52.536 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:43:52.536 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================== 2021-08-03T10:43:52.536 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:43:52.537 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.4 M 2021-08-03T10:43:52.537 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:52.537 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:43:52.537 INFO:teuthology.orchestra.run.smithi101.stdout:======================================================================================== 2021-08-03T10:43:52.538 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:43:52.538 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:52.538 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 3.4 M 2021-08-03T10:43:52.538 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 19 M 2021-08-03T10:43:52.539 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:43:52.747 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-immutable-object-cache-debuginfo-17.0.0-66 10 MB/s | 3.4 MB 00:00 2021-08-03T10:43:52.748 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:43:52.749 INFO:teuthology.orchestra.run.smithi101.stdout:Total 9.9 MB/s | 3.4 MB 00:00 2021-08-03T10:43:52.749 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:43:52.755 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:43:52.755 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:43:52.799 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:43:52.802 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:43:53.256 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:43:53.447 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:17.0.0-6630. 1/1 2021-08-03T10:43:53.650 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:17.0.0-6630. 1/1 2021-08-03T10:43:53.878 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:17.0.0-6630. 1/1 2021-08-03T10:43:53.878 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:43:54.101 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:54.101 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:43:54.101 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-immutable-object-cache-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:43:54.101 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:54.102 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:43:54.224 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-radosgw-debuginfo 2021-08-03T10:43:54.777 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:05:09 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:43:55.674 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:43:55.676 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:43:55.676 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:43:55.676 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:43:55.677 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:43:55.677 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 356 M 2021-08-03T10:43:55.677 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:55.678 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:43:55.678 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:43:55.678 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:43:55.678 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:43:55.679 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 356 M 2021-08-03T10:43:55.679 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 1.8 G 2021-08-03T10:43:55.679 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:44:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:44:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:44:03.556 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:44:03.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:44:03.801 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:44:04.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:04.031 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:44:04.032 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:44:04.032 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:04.032 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:44:05.772 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2021-08-03T10:44:06.370 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:05:20 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:44:07.784 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:44:07.785 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-08-03T10:44:07.786 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:44:07.786 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-08-03T10:44:07.786 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:44:07.786 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 3.4 M 2021-08-03T10:44:07.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:07.787 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:44:07.787 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================== 2021-08-03T10:44:07.787 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:44:07.787 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:07.788 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 3.4 M 2021-08-03T10:44:07.788 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 19 M 2021-08-03T10:44:07.788 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:44:08.672 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-immutable-object-cache-debuginfo-17.0.0-66 3.9 MB/s | 3.4 MB 00:00 2021-08-03T10:44:08.673 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:44:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.9 MB/s | 3.4 MB 00:00 2021-08-03T10:44:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:44:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:44:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:44:08.730 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:44:08.734 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:44:09.221 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:44:09.373 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:17.0.0-6630. 1/1 2021-08-03T10:44:09.606 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:17.0.0-6630. 1/1 2021-08-03T10:44:09.851 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:17.0.0-6630. 1/1 2021-08-03T10:44:09.851 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:44:10.083 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:10.084 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:44:10.084 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:44:10.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:10.085 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:44:10.201 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw-debuginfo 2021-08-03T10:44:10.790 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:05:24 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:44:11.742 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:44:11.743 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:44:11.744 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:44:11.744 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:44:11.744 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:44:11.744 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 356 M 2021-08-03T10:44:11.745 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:11.745 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:44:11.745 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:44:11.745 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:44:11.746 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:44:11.746 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 356 M 2021-08-03T10:44:11.746 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 1.8 G 2021-08-03T10:44:11.746 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:44:17.650 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-radosgw-debuginfo-17.0.0-6630.gdf0bf89f.el 16 MB/s | 356 MB 00:21 2021-08-03T10:44:17.651 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:44:17.651 INFO:teuthology.orchestra.run.smithi101.stdout:Total 16 MB/s | 356 MB 00:21 2021-08-03T10:44:17.652 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:44:17.656 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:44:17.656 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:44:19.003 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:44:19.006 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:44:40.976 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-radosgw-debuginfo-17.0.0-6630.gdf0bf89f.el 12 MB/s | 356 MB 00:29 2021-08-03T10:44:40.977 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:44:40.978 INFO:teuthology.orchestra.run.smithi003.stdout:Total 12 MB/s | 356 MB 00:29 2021-08-03T10:44:40.979 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:44:40.983 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:44:40.983 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:44:42.403 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:44:42.406 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:44:57.153 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:44:57.339 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x 1/1 2021-08-03T10:44:57.543 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x 1/1 2021-08-03T10:44:57.775 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x 1/1 2021-08-03T10:44:57.775 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:44:58.001 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:44:58.001 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:44:58.001 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:44:58.001 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:44:58.002 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:44:58.101 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-test-debuginfo 2021-08-03T10:44:58.652 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:06:13 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:44:59.591 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:44:59.592 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:44:59.593 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:44:59.593 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:44:59.593 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:44:59.594 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.1 G 2021-08-03T10:44:59.594 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:44:59.594 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:44:59.595 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:44:59.595 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:44:59.595 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:44:59.595 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 1.1 G 2021-08-03T10:44:59.595 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 0 2021-08-03T10:44:59.596 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:45:23.200 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:45:23.387 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x 1/1 2021-08-03T10:45:23.619 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x 1/1 2021-08-03T10:45:23.862 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x 1/1 2021-08-03T10:45:23.862 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:45:24.092 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:45:24.093 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:45:24.093 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:45:24.093 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:45:24.093 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:45:24.220 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-test-debuginfo 2021-08-03T10:45:24.818 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:06:38 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:45:25.808 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:45:25.809 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:45:25.809 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:45:25.809 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:45:25.810 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:45:25.810 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.1 G 2021-08-03T10:45:25.810 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:45:25.810 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:45:25.811 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:45:25.811 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:45:25.811 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:45:25.811 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 1.1 G 2021-08-03T10:45:25.812 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 0 2021-08-03T10:45:25.812 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:47:48.404 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-test-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 7.7 MB/s | 1.1 GB 02:22 2021-08-03T10:47:48.406 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:47:48.407 INFO:teuthology.orchestra.run.smithi003.stdout:Total 7.7 MB/s | 1.1 GB 02:22 2021-08-03T10:47:48.407 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:47:48.409 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:47:48.410 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:47:52.716 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:47:52.719 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:48:13.273 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-test-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 5.6 MB/s | 1.1 GB 03:13 2021-08-03T10:48:13.274 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:48:13.274 INFO:teuthology.orchestra.run.smithi101.stdout:Total 5.6 MB/s | 1.1 GB 03:13 2021-08-03T10:48:13.275 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:48:13.279 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:48:13.280 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:48:17.366 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:48:17.369 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:50:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:50:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:50:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:50:03.565 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:50:03.566 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:50:03.827 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:03.828 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:50:03.828 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:50:03.828 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:03.829 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:50:04.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-base-debuginfo 2021-08-03T10:50:04.619 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:11:18 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:50:05.335 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:50:05.576 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:50:05.577 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2021-08-03T10:50:05.577 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:50:05.653 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-debuginfo 2021-08-03T10:50:06.242 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:11:20 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:50:07.201 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:50:07.203 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:07.203 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:50:07.203 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:07.203 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:50:07.204 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 38 M 2021-08-03T10:50:07.204 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:07.204 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:50:07.204 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:07.205 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:50:07.205 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:07.205 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 38 M 2021-08-03T10:50:07.205 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 236 M 2021-08-03T10:50:07.205 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:50:12.650 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-mgr-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 6.9 MB/s | 38 MB 00:05 2021-08-03T10:50:12.652 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:50:12.652 INFO:teuthology.orchestra.run.smithi003.stdout:Total 6.9 MB/s | 38 MB 00:05 2021-08-03T10:50:12.653 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:50:12.657 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:50:12.657 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:50:12.841 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:50:12.845 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:50:17.767 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:50:17.941 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:18.169 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:18.416 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:18.417 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:50:18.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:18.653 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:50:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:50:18.653 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:18.654 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:50:18.719 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:50:18.764 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mds-debuginfo 2021-08-03T10:50:19.365 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:11:33 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:50:20.333 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:50:20.334 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:20.334 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:50:20.334 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:50:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 69 M 2021-08-03T10:50:20.335 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:50:20.335 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:50:20.336 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 69 M 2021-08-03T10:50:20.336 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 351 M 2021-08-03T10:50:20.337 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:50:20.772 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:50:21.006 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:50:21.230 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:50:21.230 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:50:21.449 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:21.449 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:50:21.449 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-test-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:50:21.450 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:21.450 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:50:21.628 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-base-debuginfo 2021-08-03T10:50:22.191 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:11:37 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:50:22.868 INFO:teuthology.orchestra.run.smithi101.stdout:Package ceph-base-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 is already installed. 2021-08-03T10:50:23.097 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:50:23.098 INFO:teuthology.orchestra.run.smithi101.stdout:Nothing to do. 2021-08-03T10:50:23.098 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:50:23.162 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mgr-debuginfo 2021-08-03T10:50:23.712 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:11:38 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:50:24.621 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:50:24.622 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:24.622 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:50:24.623 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:24.623 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:50:24.623 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 38 M 2021-08-03T10:50:24.623 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:24.623 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:50:24.624 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:24.624 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:50:24.624 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:24.624 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 38 M 2021-08-03T10:50:24.625 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 236 M 2021-08-03T10:50:24.625 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:50:28.738 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-mgr-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 9.2 MB/s | 38 MB 00:04 2021-08-03T10:50:28.739 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:50:28.740 INFO:teuthology.orchestra.run.smithi101.stdout:Total 9.2 MB/s | 38 MB 00:04 2021-08-03T10:50:28.740 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:50:28.744 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:50:28.745 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:50:28.919 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:50:28.922 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:50:34.026 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:50:34.178 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:34.411 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:34.642 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:34.642 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:50:34.849 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:34.849 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:50:34.849 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mgr-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:50:34.849 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:34.850 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:50:34.927 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mds-debuginfo 2021-08-03T10:50:35.479 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:11:50 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:50:36.384 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:50:36.385 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:36.385 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:50:36.385 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:36.385 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:50:36.386 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 69 M 2021-08-03T10:50:36.386 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:36.386 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:50:36.386 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:36.387 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:50:36.387 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:36.387 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 69 M 2021-08-03T10:50:36.387 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 351 M 2021-08-03T10:50:36.387 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:50:41.143 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-mds-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 15 MB/s | 69 MB 00:04 2021-08-03T10:50:41.146 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:50:41.147 INFO:teuthology.orchestra.run.smithi101.stdout:Total 15 MB/s | 69 MB 00:04 2021-08-03T10:50:41.148 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:50:41.151 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:50:41.151 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:50:41.441 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:50:41.445 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:50:43.453 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-mds-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 3.0 MB/s | 69 MB 00:23 2021-08-03T10:50:43.454 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:50:43.455 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.0 MB/s | 69 MB 00:23 2021-08-03T10:50:43.455 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:50:43.459 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:50:43.460 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:50:43.765 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:50:43.769 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:50:49.450 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:50:49.742 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:49.987 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:50.219 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:50.220 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:50:50.438 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:50.438 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:50:50.438 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:50:50.438 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:50.439 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:50:50.512 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-mon-debuginfo 2021-08-03T10:50:51.073 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:12:06 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:50:51.717 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:50:51.902 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:51.981 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:50:51.982 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:51.982 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:50:51.982 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:51.983 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:50:51.983 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 91 M 2021-08-03T10:50:51.983 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:51.983 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:50:51.984 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:50:51.984 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:50:51.984 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:50:51.984 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 91 M 2021-08-03T10:50:51.984 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 550 M 2021-08-03T10:50:51.985 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:50:52.163 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:52.409 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:50:52.410 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:50:52.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:52.643 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:50:52.643 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:50:52.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:52.644 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:50:52.735 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mon-debuginfo 2021-08-03T10:50:53.335 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:12:07 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:50:54.296 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:50:54.298 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:54.298 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:50:54.299 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:54.299 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:50:54.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 91 M 2021-08-03T10:50:54.299 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:54.299 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:50:54.300 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:50:54.300 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:50:54.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:50:54.300 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 91 M 2021-08-03T10:50:54.301 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 550 M 2021-08-03T10:50:54.301 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:51:11.006 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-mon-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 5.5 MB/s | 91 MB 00:16 2021-08-03T10:51:11.007 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:51:11.008 INFO:teuthology.orchestra.run.smithi003.stdout:Total 5.5 MB/s | 91 MB 00:16 2021-08-03T10:51:11.009 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:51:11.013 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:51:11.013 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:51:11.404 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:51:11.407 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:51:22.377 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:51:22.564 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:51:22.830 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:51:23.081 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:51:23.082 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:51:23.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:51:23.316 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:51:23.317 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:51:23.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:51:23.317 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:51:23.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-osd-debuginfo 2021-08-03T10:51:24.001 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:12:38 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:51:24.638 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-mon-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 2.8 MB/s | 91 MB 00:32 2021-08-03T10:51:24.640 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:51:24.640 INFO:teuthology.orchestra.run.smithi101.stdout:Total 2.8 MB/s | 91 MB 00:32 2021-08-03T10:51:24.641 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:51:24.643 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:51:24.643 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:51:24.964 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:51:24.965 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:51:24.966 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:51:24.966 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:51:24.966 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:51:24.966 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 325 M 2021-08-03T10:51:24.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:51:24.967 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:51:24.967 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:51:24.967 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:51:24.967 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:51:24.968 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 325 M 2021-08-03T10:51:24.968 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 1.7 G 2021-08-03T10:51:24.968 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:51:25.014 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:51:25.016 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:51:35.323 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:51:35.544 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:51:35.763 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:51:35.993 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:51:35.993 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:51:36.215 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:51:36.215 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:51:36.215 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-mon-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:51:36.215 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:51:36.216 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:51:36.289 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-osd-debuginfo 2021-08-03T10:51:36.844 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:12:51 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:51:37.749 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:51:37.750 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:51:37.750 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:51:37.750 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:51:37.750 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:51:37.751 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 325 M 2021-08-03T10:51:37.751 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:51:37.751 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:51:37.751 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:51:37.751 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:51:37.752 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:51:37.752 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 325 M 2021-08-03T10:51:37.752 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 1.7 G 2021-08-03T10:51:37.752 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:52:53.815 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-osd-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 3.7 MB/s | 325 MB 01:28 2021-08-03T10:52:53.815 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:52:53.816 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.7 MB/s | 325 MB 01:28 2021-08-03T10:52:53.817 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:52:53.821 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:52:53.821 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:52:55.120 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:52:55.124 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:53:17.341 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-osd-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 3.3 MB/s | 325 MB 01:39 2021-08-03T10:53:17.342 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:53:17.342 INFO:teuthology.orchestra.run.smithi101.stdout:Total 3.3 MB/s | 325 MB 01:39 2021-08-03T10:53:17.343 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:53:17.346 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:53:17.346 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:53:18.579 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:53:18.582 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:53:32.741 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:53:34.552 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:53:35.276 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:53:36.103 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:53:36.103 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:53:36.783 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:36.784 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:53:36.784 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:53:36.784 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:36.785 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:53:38.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-fuse-debuginfo 2021-08-03T10:53:39.037 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:14:53 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:53:40.458 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:53:40.459 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:40.459 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:53:40.460 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:40.460 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:53:40.460 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 16 M 2021-08-03T10:53:40.460 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:40.461 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:53:40.461 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:40.461 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:53:40.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:40.462 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 16 M 2021-08-03T10:53:40.462 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 87 M 2021-08-03T10:53:40.462 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:53:41.676 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-fuse-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 13 MB/s | 16 MB 00:01 2021-08-03T10:53:41.677 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:53:41.678 INFO:teuthology.orchestra.run.smithi003.stdout:Total 13 MB/s | 16 MB 00:01 2021-08-03T10:53:41.678 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:53:41.682 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:53:41.682 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:53:41.785 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:53:41.788 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:53:43.739 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:53:43.950 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:53:44.208 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:53:44.452 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:53:44.453 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:53:44.686 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:44.686 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:53:44.687 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:53:44.687 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:44.687 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:53:44.772 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados-devel-debuginfo 2021-08-03T10:53:45.360 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:14:59 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:53:46.325 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:53:46.326 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:46.327 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:53:46.327 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:46.327 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:53:46.327 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 152 k 2021-08-03T10:53:46.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:46.328 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:53:46.328 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:46.328 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:53:46.328 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:46.329 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 152 k 2021-08-03T10:53:46.329 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 923 k 2021-08-03T10:53:46.329 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:53:46.590 INFO:teuthology.orchestra.run.smithi003.stdout:librados-devel-debuginfo-17.0.0-6630.gdf0bf89f. 578 kB/s | 152 kB 00:00 2021-08-03T10:53:46.591 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:53:46.592 INFO:teuthology.orchestra.run.smithi003.stdout:Total 575 kB/s | 152 kB 00:00 2021-08-03T10:53:46.592 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:53:46.595 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:53:46.595 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:53:46.632 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:53:46.636 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:53:46.785 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:53:47.007 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:53:47.237 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:53:47.489 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:53:47.489 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:53:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:47.723 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:53:47.723 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:53:47.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:47.724 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:53:47.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs2-debuginfo 2021-08-03T10:53:48.377 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:15:02 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:53:49.322 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:53:49.323 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:49.324 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:53:49.324 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:49.324 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:53:49.325 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 14 M 2021-08-03T10:53:49.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:49.325 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:53:49.325 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:49.326 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:53:49.326 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:49.326 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 14 M 2021-08-03T10:53:49.326 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 81 M 2021-08-03T10:53:49.327 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:53:51.553 INFO:teuthology.orchestra.run.smithi003.stdout:libcephfs2-debuginfo-17.0.0-6630.gdf0bf89f.el8. 6.5 MB/s | 14 MB 00:02 2021-08-03T10:53:51.554 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:53:51.555 INFO:teuthology.orchestra.run.smithi003.stdout:Total 6.5 MB/s | 14 MB 00:02 2021-08-03T10:53:51.555 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:53:51.559 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:53:51.559 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:53:51.655 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:53:51.659 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:53:53.438 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:53:53.640 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:53:53.750 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:53:53.866 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:53:54.121 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:53:54.122 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:53:54.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:54.385 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:53:54.386 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:53:54.386 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:54.386 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:53:54.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados2-debuginfo 2021-08-03T10:53:55.055 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:15:09 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:53:55.725 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:53:56.014 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:53:56.015 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:56.015 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:53:56.015 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:56.016 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:53:56.016 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 77 M 2021-08-03T10:53:56.016 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:56.016 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:53:56.016 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:53:56.017 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:53:56.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:53:56.017 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 77 M 2021-08-03T10:53:56.017 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 489 M 2021-08-03T10:53:56.018 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:53:56.519 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:53:57.002 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:53:57.002 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:53:57.748 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:53:57.748 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:53:57.749 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-osd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:53:57.749 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:53:57.749 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:53:59.477 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install ceph-fuse-debuginfo 2021-08-03T10:54:00.034 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:15:15 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:54:00.762 INFO:teuthology.orchestra.run.smithi003.stdout:librados2-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 16 MB/s | 77 MB 00:04 2021-08-03T10:54:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:00.764 INFO:teuthology.orchestra.run.smithi003.stdout:Total 16 MB/s | 77 MB 00:04 2021-08-03T10:54:00.765 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:54:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:54:00.769 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:54:00.969 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:54:00.971 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:00.971 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:54:00.971 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:00.971 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:54:00.972 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 16 M 2021-08-03T10:54:00.972 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:00.972 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:54:00.972 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:00.973 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:54:00.973 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:00.973 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 16 M 2021-08-03T10:54:00.973 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 87 M 2021-08-03T10:54:00.973 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:54:01.123 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:54:01.126 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:54:02.603 INFO:teuthology.orchestra.run.smithi101.stdout:ceph-fuse-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 9.8 MB/s | 16 MB 00:01 2021-08-03T10:54:02.604 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:02.605 INFO:teuthology.orchestra.run.smithi101.stdout:Total 9.8 MB/s | 16 MB 00:01 2021-08-03T10:54:02.605 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:54:02.608 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:54:02.609 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:54:02.704 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:54:02.707 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:54:04.526 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:54:04.783 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:04.988 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:05.217 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:05.217 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:54:05.437 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:05.437 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:54:05.437 INFO:teuthology.orchestra.run.smithi101.stdout: ceph-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:05.438 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:05.438 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:54:05.538 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install librados-devel-debuginfo 2021-08-03T10:54:06.142 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:15:21 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:54:07.050 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:54:07.051 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:07.051 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:54:07.051 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:07.052 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:54:07.052 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 152 k 2021-08-03T10:54:07.052 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:07.052 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:54:07.052 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:07.053 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:54:07.053 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:07.053 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 152 k 2021-08-03T10:54:07.053 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 923 k 2021-08-03T10:54:07.054 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:54:07.580 INFO:teuthology.orchestra.run.smithi101.stdout:librados-devel-debuginfo-17.0.0-6630.gdf0bf89f. 288 kB/s | 152 kB 00:00 2021-08-03T10:54:07.581 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:07.581 INFO:teuthology.orchestra.run.smithi101.stdout:Total 287 kB/s | 152 kB 00:00 2021-08-03T10:54:07.582 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:54:07.584 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:54:07.585 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:54:07.620 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:54:07.622 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:54:07.787 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:54:07.983 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:54:08.183 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:54:08.421 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:54:08.422 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:54:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:08.637 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:54:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: librados-devel-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:08.637 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:08.638 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:54:08.701 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install libcephfs2-debuginfo 2021-08-03T10:54:09.255 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:15:24 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:54:10.666 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:54:10.749 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:54:10.750 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:10.750 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:54:10.750 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:10.751 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:54:10.751 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 14 M 2021-08-03T10:54:10.751 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:10.751 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:54:10.752 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:10.752 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:54:10.752 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:10.752 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 14 M 2021-08-03T10:54:10.752 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 81 M 2021-08-03T10:54:10.753 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:54:10.838 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:11.063 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:11.303 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:11.303 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:54:11.543 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:11.544 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:54:11.544 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:11.544 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:11.544 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:54:11.626 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librbd1-debuginfo 2021-08-03T10:54:12.218 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:15:26 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:54:13.686 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:54:13.687 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:13.688 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:54:13.688 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:13.688 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:54:13.689 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 121 M 2021-08-03T10:54:13.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:13.689 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:54:13.690 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:13.690 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:54:13.690 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:13.690 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 121 M 2021-08-03T10:54:13.691 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 724 M 2021-08-03T10:54:13.691 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:54:13.802 INFO:teuthology.orchestra.run.smithi101.stdout:libcephfs2-debuginfo-17.0.0-6630.gdf0bf89f.el8. 4.7 MB/s | 14 MB 00:03 2021-08-03T10:54:13.803 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:13.804 INFO:teuthology.orchestra.run.smithi101.stdout:Total 4.7 MB/s | 14 MB 00:03 2021-08-03T10:54:13.804 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:54:13.808 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:54:13.808 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:54:13.898 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:54:13.901 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:54:16.129 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:54:16.307 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:54:16.549 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:54:16.787 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:54:16.788 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:54:16.994 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:16.994 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:54:16.995 INFO:teuthology.orchestra.run.smithi101.stdout: libcephfs2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:16.995 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:16.995 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:54:17.060 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install librados2-debuginfo 2021-08-03T10:54:17.612 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:15:32 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:54:18.551 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:54:18.553 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:18.553 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:54:18.553 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:18.553 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:54:18.553 INFO:teuthology.orchestra.run.smithi101.stdout: librados2-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 77 M 2021-08-03T10:54:18.554 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:18.554 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:54:18.554 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:18.554 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:54:18.555 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:18.555 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 77 M 2021-08-03T10:54:18.555 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 489 M 2021-08-03T10:54:18.555 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:54:24.890 INFO:teuthology.orchestra.run.smithi003.stdout:librbd1-debuginfo-17.0.0-6630.gdf0bf89f.el8.x86 11 MB/s | 121 MB 00:11 2021-08-03T10:54:24.891 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:24.891 INFO:teuthology.orchestra.run.smithi003.stdout:Total 11 MB/s | 121 MB 00:11 2021-08-03T10:54:24.892 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:54:24.896 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:54:24.896 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:54:25.421 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:54:25.424 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:54:32.267 INFO:teuthology.orchestra.run.smithi101.stdout:librados2-debuginfo-17.0.0-6630.gdf0bf89f.el8.x 5.6 MB/s | 77 MB 00:13 2021-08-03T10:54:32.268 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:32.268 INFO:teuthology.orchestra.run.smithi101.stdout:Total 5.6 MB/s | 77 MB 00:13 2021-08-03T10:54:32.269 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:54:32.273 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:54:32.273 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:54:32.606 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:54:32.610 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:54:40.073 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:54:40.266 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:54:40.493 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:54:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:54:40.741 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:54:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:40.969 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:54:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:40.970 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:54:41.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-cephfs-debuginfo 2021-08-03T10:54:41.504 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:54:41.648 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:15:55 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:54:41.695 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:41.913 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:42.141 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_ 1/1 2021-08-03T10:54:42.142 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:54:42.356 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: librados2-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:42.357 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:42.358 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:54:42.437 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install librbd1-debuginfo 2021-08-03T10:54:42.818 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:54:42.819 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:42.820 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:54:42.820 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:42.820 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:54:42.820 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 553 k 2021-08-03T10:54:42.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:42.821 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:54:42.821 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:42.821 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:54:42.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:42.822 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 553 k 2021-08-03T10:54:42.822 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 2.7 M 2021-08-03T10:54:42.822 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:54:42.993 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:15:57 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:54:43.083 INFO:teuthology.orchestra.run.smithi003.stdout:python3-cephfs-debuginfo-17.0.0-6630.gdf0bf89f. 2.1 MB/s | 553 kB 00:00 2021-08-03T10:54:43.084 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:43.084 INFO:teuthology.orchestra.run.smithi003.stdout:Total 2.0 MB/s | 553 kB 00:00 2021-08-03T10:54:43.084 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:54:43.087 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:54:43.087 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:54:43.126 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:54:43.130 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:54:43.274 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:54:43.532 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:54:43.743 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:54:43.929 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:54:43.929 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:43.929 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:54:43.930 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:43.930 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:54:43.930 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 121 M 2021-08-03T10:54:43.930 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:43.930 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:54:43.931 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:54:43.931 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:54:43.931 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:54:43.932 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 121 M 2021-08-03T10:54:43.932 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 724 M 2021-08-03T10:54:43.933 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:54:43.995 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:54:43.995 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:54:44.230 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:44.230 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:54:44.231 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:44.231 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:44.231 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:54:44.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rados-debuginfo 2021-08-03T10:54:44.894 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:15:58 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:54:45.855 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:54:45.856 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:45.856 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:54:45.856 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:45.857 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:54:45.857 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 705 k 2021-08-03T10:54:45.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:45.857 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:54:45.858 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:45.858 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:54:45.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:45.858 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 705 k 2021-08-03T10:54:45.858 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 3.4 M 2021-08-03T10:54:45.859 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:54:46.472 INFO:teuthology.orchestra.run.smithi003.stdout:python3-rados-debuginfo-17.0.0-6630.gdf0bf89f.e 1.1 MB/s | 705 kB 00:00 2021-08-03T10:54:46.473 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:46.474 INFO:teuthology.orchestra.run.smithi003.stdout:Total 1.1 MB/s | 705 kB 00:00 2021-08-03T10:54:46.474 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:54:46.477 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:54:46.478 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:54:46.518 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:54:46.521 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:54:46.683 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:54:46.932 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8. 1/1 2021-08-03T10:54:47.157 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8. 1/1 2021-08-03T10:54:47.405 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8. 1/1 2021-08-03T10:54:47.405 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:54:47.637 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:47.638 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:54:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:47.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:47.638 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:54:47.724 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rbd-debuginfo 2021-08-03T10:54:48.315 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:16:02 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:54:49.263 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:54:49.264 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:49.264 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:54:49.265 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:49.265 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:54:49.265 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.1 M 2021-08-03T10:54:49.265 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:49.266 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:54:49.266 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:49.266 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:54:49.266 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 1.1 M 2021-08-03T10:54:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 5.7 M 2021-08-03T10:54:49.267 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:54:49.349 INFO:teuthology.orchestra.run.smithi101.stdout:librbd1-debuginfo-17.0.0-6630.gdf0bf89f.el8.x86 22 MB/s | 121 MB 00:05 2021-08-03T10:54:49.350 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:49.351 INFO:teuthology.orchestra.run.smithi101.stdout:Total 22 MB/s | 121 MB 00:05 2021-08-03T10:54:49.352 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:54:49.355 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:54:49.355 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:54:49.524 INFO:teuthology.orchestra.run.smithi003.stdout:python3-rbd-debuginfo-17.0.0-6630.gdf0bf89f.el8 4.1 MB/s | 1.1 MB 00:00 2021-08-03T10:54:49.525 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:49.525 INFO:teuthology.orchestra.run.smithi003.stdout:Total 4.1 MB/s | 1.1 MB 00:00 2021-08-03T10:54:49.525 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:54:49.528 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:54:49.528 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:54:49.569 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:54:49.572 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:54:49.779 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:54:49.854 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:54:49.857 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:54:50.034 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:54:50.259 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:54:50.496 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:54:50.497 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:54:50.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:50.729 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:54:50.729 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:50.730 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:50.730 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:54:50.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rgw-debuginfo 2021-08-03T10:54:51.393 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:16:05 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:54:52.392 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:54:52.393 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:52.393 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:54:52.393 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:52.393 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:54:52.394 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 312 k 2021-08-03T10:54:52.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:52.394 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:54:52.394 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:52.395 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:54:52.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:52.395 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 312 k 2021-08-03T10:54:52.395 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 1.4 M 2021-08-03T10:54:52.395 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:54:52.589 INFO:teuthology.orchestra.run.smithi003.stdout:python3-rgw-debuginfo-17.0.0-6630.gdf0bf89f.el8 1.6 MB/s | 312 kB 00:00 2021-08-03T10:54:52.590 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:52.591 INFO:teuthology.orchestra.run.smithi003.stdout:Total 1.5 MB/s | 312 kB 00:00 2021-08-03T10:54:52.591 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:54:52.594 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:54:52.594 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:54:52.633 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:54:52.637 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:54:52.771 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:54:52.972 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:54:53.204 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:54:53.476 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:54:53.476 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:54:53.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:53.718 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:54:53.718 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:53.718 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:53.719 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:54:53.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-fuse-debuginfo 2021-08-03T10:54:54.394 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:16:08 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:54:55.353 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:54:55.354 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:55.354 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:54:55.354 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:55.355 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:54:55.355 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.5 M 2021-08-03T10:54:55.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:55.355 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:54:55.356 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:55.356 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:54:55.356 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:55.356 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 1.5 M 2021-08-03T10:54:55.356 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 9.2 M 2021-08-03T10:54:55.357 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:54:55.614 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-fuse-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 5.9 MB/s | 1.5 MB 00:00 2021-08-03T10:54:55.615 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:54:55.615 INFO:teuthology.orchestra.run.smithi003.stdout:Total 5.9 MB/s | 1.5 MB 00:00 2021-08-03T10:54:55.615 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:54:55.618 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:54:55.619 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:54:55.662 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:54:55.665 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:54:55.928 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:54:56.147 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:54:56.365 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:54:56.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:54:56.611 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:54:56.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:56.853 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:54:56.853 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:54:56.853 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:56.854 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:54:56.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-mirror-debuginfo 2021-08-03T10:54:57.525 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:16:11 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:54:59.049 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:54:59.050 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:59.051 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:54:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:54:59.052 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 115 M 2021-08-03T10:54:59.052 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:59.052 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:54:59.052 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:54:59.053 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:54:59.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:54:59.053 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 115 M 2021-08-03T10:54:59.053 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 666 M 2021-08-03T10:54:59.053 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:55:03.532 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:05.543 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:06.079 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-mirror-debuginfo-17.0.0-6630.gdf0bf89f.el8. 16 MB/s | 115 MB 00:07 2021-08-03T10:55:06.080 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:06.081 INFO:teuthology.orchestra.run.smithi003.stdout:Total 16 MB/s | 115 MB 00:07 2021-08-03T10:55:06.082 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:55:06.085 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:55:06.086 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:55:06.356 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:06.572 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:55:06.575 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:55:06.679 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:06.680 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:06.903 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:06.903 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:06.904 INFO:teuthology.orchestra.run.smithi101.stdout: librbd1-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:06.904 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:06.904 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:06.976 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-cephfs-debuginfo 2021-08-03T10:55:07.528 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:16:22 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:55:08.427 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:55:08.429 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:08.429 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:55:08.430 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:08.430 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:55:08.430 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 553 k 2021-08-03T10:55:08.431 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:08.431 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:55:08.432 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:08.432 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:55:08.433 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:08.433 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 553 k 2021-08-03T10:55:08.433 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 2.7 M 2021-08-03T10:55:08.434 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:55:08.645 INFO:teuthology.orchestra.run.smithi101.stdout:python3-cephfs-debuginfo-17.0.0-6630.gdf0bf89f. 2.5 MB/s | 553 kB 00:00 2021-08-03T10:55:08.646 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:08.647 INFO:teuthology.orchestra.run.smithi101.stdout:Total 2.5 MB/s | 553 kB 00:00 2021-08-03T10:55:08.647 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:55:08.650 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:55:08.650 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:55:08.685 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:55:08.688 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:55:08.826 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:09.083 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:55:09.301 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:55:09.518 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8 1/1 2021-08-03T10:55:09.518 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:09.735 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:09.736 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:09.736 INFO:teuthology.orchestra.run.smithi101.stdout: python3-cephfs-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:09.736 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:09.736 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:09.831 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-rados-debuginfo 2021-08-03T10:55:10.382 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:16:25 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:55:11.290 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:55:11.291 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:11.291 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:55:11.292 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:11.292 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:55:11.292 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 705 k 2021-08-03T10:55:11.293 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:11.293 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:55:11.293 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:11.293 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:55:11.294 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:11.294 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 705 k 2021-08-03T10:55:11.294 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 3.4 M 2021-08-03T10:55:11.295 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:55:11.561 INFO:teuthology.orchestra.run.smithi101.stdout:python3-rados-debuginfo-17.0.0-6630.gdf0bf89f.e 2.6 MB/s | 705 kB 00:00 2021-08-03T10:55:11.561 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:11.562 INFO:teuthology.orchestra.run.smithi101.stdout:Total 2.5 MB/s | 705 kB 00:00 2021-08-03T10:55:11.562 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:55:11.565 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:55:11.566 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:55:11.603 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:55:11.606 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:55:12.074 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:12.283 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8. 1/1 2021-08-03T10:55:12.499 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8. 1/1 2021-08-03T10:55:12.718 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8. 1/1 2021-08-03T10:55:12.910 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:12.935 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:12.936 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:12.936 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rados-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:12.936 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:12.937 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:13.008 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-rbd-debuginfo 2021-08-03T10:55:13.591 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:16:28 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:55:14.524 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:55:14.525 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:14.525 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:55:14.525 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:14.526 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:55:14.526 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.1 M 2021-08-03T10:55:14.526 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:14.526 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:55:14.527 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:14.527 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:55:14.527 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:14.528 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 1.1 M 2021-08-03T10:55:14.528 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 5.7 M 2021-08-03T10:55:14.528 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:55:15.239 INFO:teuthology.orchestra.run.smithi101.stdout:python3-rbd-debuginfo-17.0.0-6630.gdf0bf89f.el8 1.5 MB/s | 1.1 MB 00:00 2021-08-03T10:55:15.240 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:15.240 INFO:teuthology.orchestra.run.smithi101.stdout:Total 1.5 MB/s | 1.1 MB 00:00 2021-08-03T10:55:15.241 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:55:15.244 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:55:15.244 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:55:15.283 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:55:15.286 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:55:15.518 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:15.765 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:55:15.985 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:55:16.211 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:55:16.211 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:16.426 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:16.427 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:16.427 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:16.427 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:16.427 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:16.527 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install python3-rgw-debuginfo 2021-08-03T10:55:17.078 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:16:32 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:55:17.988 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:55:17.989 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:17.990 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:55:17.991 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:17.991 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:55:17.992 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 312 k 2021-08-03T10:55:17.993 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:17.993 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:55:17.994 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:17.995 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:55:17.995 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:17.996 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 312 k 2021-08-03T10:55:17.997 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 1.4 M 2021-08-03T10:55:17.998 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:55:18.501 INFO:teuthology.orchestra.run.smithi101.stdout:python3-rgw-debuginfo-17.0.0-6630.gdf0bf89f.el8 607 kB/s | 312 kB 00:00 2021-08-03T10:55:18.503 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:18.503 INFO:teuthology.orchestra.run.smithi101.stdout:Total 605 kB/s | 312 kB 00:00 2021-08-03T10:55:18.504 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:55:18.506 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:55:18.506 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:55:18.542 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:55:18.545 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:55:18.660 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:18.873 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:55:19.079 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:55:19.307 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x8 1/1 2021-08-03T10:55:19.307 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:19.526 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:19.526 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:19.526 INFO:teuthology.orchestra.run.smithi101.stdout: python3-rgw-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:19.527 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:19.527 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:19.599 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install rbd-fuse-debuginfo 2021-08-03T10:55:20.153 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:16:35 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:55:20.879 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:55:21.047 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:55:21.048 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:21.048 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:55:21.049 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:21.049 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:55:21.049 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 1.5 M 2021-08-03T10:55:21.049 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:21.049 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:55:21.050 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:21.050 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:55:21.050 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:21.050 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 1.5 M 2021-08-03T10:55:21.051 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 9.2 M 2021-08-03T10:55:21.051 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:55:21.068 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:55:21.300 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:55:21.312 INFO:teuthology.orchestra.run.smithi101.stdout:rbd-fuse-debuginfo-17.0.0-6630.gdf0bf89f.el8.x8 5.8 MB/s | 1.5 MB 00:00 2021-08-03T10:55:21.312 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:21.313 INFO:teuthology.orchestra.run.smithi101.stdout:Total 5.8 MB/s | 1.5 MB 00:00 2021-08-03T10:55:21.313 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:55:21.316 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:55:21.316 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:55:21.355 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:55:21.358 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:55:21.552 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:55:21.552 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:55:21.605 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:21.806 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:55:21.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:21.897 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:55:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:21.897 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:21.897 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:55:22.021 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:55:22.029 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-nbd-debuginfo 2021-08-03T10:55:22.250 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_6 1/1 2021-08-03T10:55:22.251 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:22.618 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:16:36 ago on Tue 03 Aug 2021 10:38:46 AM UTC. 2021-08-03T10:55:22.943 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:22.944 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:22.944 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-fuse-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:22.944 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:22.944 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:23.661 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2021-08-03T10:55:23.662 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:55:23.662 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2021-08-03T10:55:23.663 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:55:23.663 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2021-08-03T10:55:23.663 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 2.3 M 2021-08-03T10:55:23.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:23.663 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2021-08-03T10:55:23.664 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2021-08-03T10:55:23.664 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2021-08-03T10:55:23.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:23.664 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 2.3 M 2021-08-03T10:55:23.665 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 14 M 2021-08-03T10:55:23.665 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2021-08-03T10:55:23.952 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-nbd-debuginfo-17.0.0-6630.gdf0bf89f.el8.x86 8.1 MB/s | 2.3 MB 00:00 2021-08-03T10:55:23.953 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:23.954 INFO:teuthology.orchestra.run.smithi003.stdout:Total 8.0 MB/s | 2.3 MB 00:00 2021-08-03T10:55:23.954 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2021-08-03T10:55:23.957 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2021-08-03T10:55:23.957 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2021-08-03T10:55:24.003 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2021-08-03T10:55:24.007 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2021-08-03T10:55:24.375 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2021-08-03T10:55:24.576 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:24.693 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install rbd-mirror-debuginfo 2021-08-03T10:55:24.803 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:25.046 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:25.047 INFO:teuthology.orchestra.run.smithi003.stdout:Installed products updated. 2021-08-03T10:55:25.270 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:16:40 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:55:25.273 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:25.274 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2021-08-03T10:55:25.274 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:25.274 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:25.275 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2021-08-03T10:55:25.349 DEBUG:teuthology.parallel:result is None 2021-08-03T10:55:26.692 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:55:26.693 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:26.693 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:55:26.694 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:26.694 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:55:26.694 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 115 M 2021-08-03T10:55:26.694 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:26.695 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:55:26.695 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:26.695 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:55:26.695 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:26.696 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 115 M 2021-08-03T10:55:26.696 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 666 M 2021-08-03T10:55:26.696 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:55:33.877 INFO:teuthology.orchestra.run.smithi101.stdout:rbd-mirror-debuginfo-17.0.0-6630.gdf0bf89f.el8. 16 MB/s | 115 MB 00:07 2021-08-03T10:55:33.879 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:33.879 INFO:teuthology.orchestra.run.smithi101.stdout:Total 16 MB/s | 115 MB 00:07 2021-08-03T10:55:33.880 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:55:33.883 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:55:33.884 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:55:34.349 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:55:34.352 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:55:47.255 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:47.470 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:55:47.676 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:55:47.919 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86 1/1 2021-08-03T10:55:47.919 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:48.139 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:48.139 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:48.140 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-mirror-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:48.140 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:48.140 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:48.218 DEBUG:teuthology.orchestra.run.smithi101:> sudo yum -y install rbd-nbd-debuginfo 2021-08-03T10:55:48.772 INFO:teuthology.orchestra.run.smithi101.stdout:Last metadata expiration check: 0:17:03 ago on Tue 03 Aug 2021 10:38:45 AM UTC. 2021-08-03T10:55:49.673 INFO:teuthology.orchestra.run.smithi101.stdout:Dependencies resolved. 2021-08-03T10:55:49.674 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:49.674 INFO:teuthology.orchestra.run.smithi101.stdout: Package Arch Version Repo Size 2021-08-03T10:55:49.675 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:49.675 INFO:teuthology.orchestra.run.smithi101.stdout:Installing: 2021-08-03T10:55:49.675 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd-debuginfo x86_64 2:17.0.0-6630.gdf0bf89f.el8 ceph 2.3 M 2021-08-03T10:55:49.675 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:49.676 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction Summary 2021-08-03T10:55:49.676 INFO:teuthology.orchestra.run.smithi101.stdout:================================================================================ 2021-08-03T10:55:49.676 INFO:teuthology.orchestra.run.smithi101.stdout:Install 1 Package 2021-08-03T10:55:49.676 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:49.676 INFO:teuthology.orchestra.run.smithi101.stdout:Total download size: 2.3 M 2021-08-03T10:55:49.677 INFO:teuthology.orchestra.run.smithi101.stdout:Installed size: 14 M 2021-08-03T10:55:49.677 INFO:teuthology.orchestra.run.smithi101.stdout:Downloading Packages: 2021-08-03T10:55:49.963 INFO:teuthology.orchestra.run.smithi101.stdout:rbd-nbd-debuginfo-17.0.0-6630.gdf0bf89f.el8.x86 8.1 MB/s | 2.3 MB 00:00 2021-08-03T10:55:49.963 INFO:teuthology.orchestra.run.smithi101.stdout:-------------------------------------------------------------------------------- 2021-08-03T10:55:49.964 INFO:teuthology.orchestra.run.smithi101.stdout:Total 8.1 MB/s | 2.3 MB 00:00 2021-08-03T10:55:49.965 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction check 2021-08-03T10:55:49.967 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction check succeeded. 2021-08-03T10:55:49.968 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction test 2021-08-03T10:55:50.010 INFO:teuthology.orchestra.run.smithi101.stdout:Transaction test succeeded. 2021-08-03T10:55:50.013 INFO:teuthology.orchestra.run.smithi101.stdout:Running transaction 2021-08-03T10:55:50.355 INFO:teuthology.orchestra.run.smithi101.stdout: Preparing : 1/1 2021-08-03T10:55:50.544 INFO:teuthology.orchestra.run.smithi101.stdout: Installing : rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:50.794 INFO:teuthology.orchestra.run.smithi101.stdout: Running scriptlet: rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:51.015 INFO:teuthology.orchestra.run.smithi101.stdout: Verifying : rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 1/1 2021-08-03T10:55:51.016 INFO:teuthology.orchestra.run.smithi101.stdout:Installed products updated. 2021-08-03T10:55:51.229 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:51.230 INFO:teuthology.orchestra.run.smithi101.stdout:Installed: 2021-08-03T10:55:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: rbd-nbd-debuginfo-2:17.0.0-6630.gdf0bf89f.el8.x86_64 2021-08-03T10:55:51.230 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:51.231 INFO:teuthology.orchestra.run.smithi101.stdout:Complete! 2021-08-03T10:55:51.304 DEBUG:teuthology.parallel:result is None 2021-08-03T10:55:51.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo lsb_release -is 2021-08-03T10:55:51.346 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS 2021-08-03T10:55:51.347 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-03T10:55:51.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df0bf89fcfd3db43ce7267598c7265ea8975a515 2021-08-03T10:55:51.516 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-08-03T10:55:51.540 INFO:teuthology.orchestra.run.smithi003.stdout:17.0.0-6630.gdf0bf89f.el8 2021-08-03T10:55:51.540 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-6630.gdf0bf89f.el8 2021-08-03T10:55:51.541 INFO:teuthology.task.install:The correct ceph version 17.0.0-6630.gdf0bf89f is installed. 2021-08-03T10:55:51.541 DEBUG:teuthology.orchestra.run.smithi101:> sudo lsb_release -is 2021-08-03T10:55:51.574 INFO:teuthology.orchestra.run.smithi101.stdout:CentOS 2021-08-03T10:55:51.575 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-03T10:55:51.576 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=df0bf89fcfd3db43ce7267598c7265ea8975a515 2021-08-03T10:55:51.740 DEBUG:teuthology.orchestra.run.smithi101:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-08-03T10:55:51.759 INFO:teuthology.orchestra.run.smithi101.stdout:17.0.0-6630.gdf0bf89f.el8 2021-08-03T10:55:51.759 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-6630.gdf0bf89f.el8 2021-08-03T10:55:51.760 INFO:teuthology.task.install:The correct ceph version 17.0.0-6630.gdf0bf89f is installed. 2021-08-03T10:55:51.760 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-08-03T10:55:51.761 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:51.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-08-03T10:55:51.791 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:55:51.791 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-08-03T10:55:51.822 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-08-03T10:55:51.823 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:51.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2021-08-03T10:55:51.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-08-03T10:55:51.929 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:55:51.929 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/daemon-helper 2021-08-03T10:55:51.953 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-08-03T10:55:52.017 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-08-03T10:55:52.018 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:52.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2021-08-03T10:55:52.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-08-03T10:55:52.114 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:55:52.114 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/usr/bin/adjust-ulimits 2021-08-03T10:55:52.138 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-08-03T10:55:52.201 INFO:teuthology.run_tasks:Running task ceph... 2021-08-03T10:55:52.262 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-08-03T10:55:52.263 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2021-08-03T10:55:52.266 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 777 /var/log/ceph 2021-08-03T10:55:52.292 INFO:tasks.ceph:Disabling ceph logrotate... 2021-08-03T10:55:52.292 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2021-08-03T10:55:52.335 DEBUG:teuthology.orchestra.run.smithi101:> sudo rm -f -- /etc/logrotate.d/ceph 2021-08-03T10:55:52.360 INFO:tasks.ceph:Creating extra log directories... 2021-08-03T10:55:52.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-08-03T10:55:52.402 DEBUG:teuthology.orchestra.run.smithi101:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-08-03T10:55:52.440 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-08-03T10:55:52.440 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(OSDMAP_FLAGS\\)', '\\(SMALLER_PGP_NUM\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW OPS\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-08-03T10:55:52.441 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi/6309289', 'branch': 'wip-kefu-testing2-2021-08-03-1601', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '6309289', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kchai-2021-08-03_10:14:51-rados-wip-kefu-testing2-2021-08-03-1601-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing2-2021-08-03-1601'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(OSDMAP_FLAGS\\)', '\\(SMALLER_PGP_NUM\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW OPS\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'debuginfo': True, 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-kefu-testing2-2021-08-03-1601', 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515'}}, 'owner': 'scheduled_kchai@teuthology', 'priority': 60, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-kefu-testing2-2021-08-03-1601', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_df0bf89fcfd3db43ce7267598c7265ea8975a515/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'df0bf89fcfd3db43ce7267598c7265ea8975a515', 'targets': {'smithi003.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeCeLu/MKw3M9U/b5QFNlhrXRS8VhUntsaF5R7BeaqCmAIN9oAVPXGrfrSRDuB3vROLWhvyQE112du2Shod0lZrzjmed1v9IDkJSMkYq3AoB48tgN/jIyZZaywgQMgcozx5fgtGKx4HKNUy2YgYhnILTPt+pbVjUWTVhwmCtRCG1Fmto3S1VTk7c0VYGF89fGmAeo0JjRiHaBJQ2Z/I0m63A7IckwgGDaNIlNn/BiL+zg4e4JWK+Pt9o5qpmQsYy3B26V9T7ZQXhD2EU7sqLLfKJkusdEjfgCX1/J/S7L/ZsD+26ESJIzAT/x4Fkby+I5SReIStn6yssZtpXWq3FOSCD4JmIAoNEGMSoN5ODd93wR/NnJQkhwNhvDOdXoxFYPVLOZ4zkmtggq8vD0zB769C6a7gdnVoPYDPA8Vs74D49V+rNxqFlsdEqZ/zm9ty7gagI9NSCjpo90cgPRXwy16zxKzIuMSdCK6EJV82U/mgkYlgXVJDUpoxWSmnGe/IzE=', 'smithi101.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8VxFem3KORPrPo/3k95i0ENIYzOGChPkzxRV6tmWI3vTKyXYFQNibEvLyWMlVrOXPSX7pDMKp+EUhgcC5TK9sWU/0nYbeKEINIE/kC+KIeOHBIZd7K3e1aSij2aefnYzppX+rLIIRCrP5YEXsNtFRi4A0PvI6GQH0KRZKysSlhOad3MUE5HYodj467uIS6FDfwopukPxgaByJtl85s502bvlPTT1Wak1yAcgSCsvhj4J86l9V+B/F62SLwRThSg3b4G/BrUaK7Na65qjTFVE+qAJ4SszdIFmAoWZLosfspCfRp3ccpqhevXYbWMuTTw7JveTpT56gExOAB1D8lZ6Hdt1hrv5xTV1HowadicaA4w6yUAUHd8he9u4kNa0zG+pyaxvuJk7t6xPs1aRzsDXP3UbzmbG6wTQq7wo7o/mTtRWTC4IvXRmN6quTl4WYy4koJrzNRUCOuorHc1azcJ8jvY+LVsLIQUjkbRIrwUwY5KEcM/FgpcsDtgxeIL101k8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200}}, {'mon_recovery': None}], 'teuthology_branch': 'master', 'teuthology_sha1': '73aa7e3b960c7ffac669297b6aa86606265edd1b', 'timestamp': '2021-08-03_10:14:51', 'tube': 'smithi', 'user': 'kchai', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-08-03T10:55:52.442 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-08-03T10:55:52.471 DEBUG:teuthology.orchestra.run.smithi101:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-08-03T10:55:52.486 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2021-08-03T10:55:52.533 DEBUG:teuthology.orchestra.run.smithi101:> sudo install -d -m0777 -- /var/run/ceph 2021-08-03T10:55:52.557 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:52.557 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2021-08-03T10:55:52.610 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-08-03T10:55:52.611 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-08-03T10:55:52.667 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-08-03T10:55:52.667 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:52.668 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 108861 Links: 1 2021-08-03T10:55:52.668 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:52.668 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:52.668 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-08-03 10:41:06.741145299 +0000 2021-08-03T10:55:52.669 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-08-03 10:38:03.803988288 +0000 2021-08-03T10:55:52.669 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-08-03 10:38:03.803988288 +0000 2021-08-03T10:55:52.669 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-08-03T10:55:52.678 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-08-03T10:55:52.678 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-08-03T10:55:52.678 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000239116 s, 2.1 MB/s 2021-08-03T10:55:52.681 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-08-03T10:55:52.736 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-08-03T10:55:52.737 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:52.737 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 104441 Links: 1 2021-08-03T10:55:52.737 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:52.737 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:52.738 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-08-03 10:41:06.741145299 +0000 2021-08-03T10:55:52.738 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-08-03 10:38:04.151983602 +0000 2021-08-03T10:55:52.738 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-08-03 10:38:04.151983602 +0000 2021-08-03T10:55:52.738 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-08-03T10:55:52.747 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-08-03T10:55:52.747 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-08-03T10:55:52.747 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000243312 s, 2.1 MB/s 2021-08-03T10:55:52.750 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-08-03T10:55:52.805 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-08-03T10:55:52.805 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:52.806 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 112826 Links: 1 2021-08-03T10:55:52.806 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:52.806 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:52.808 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-08-03 10:41:06.741145299 +0000 2021-08-03T10:55:52.808 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-08-03 10:38:04.502978874 +0000 2021-08-03T10:55:52.808 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-08-03 10:38:04.502978874 +0000 2021-08-03T10:55:52.809 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-08-03T10:55:52.816 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-08-03T10:55:52.816 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-08-03T10:55:52.816 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000228575 s, 2.2 MB/s 2021-08-03T10:55:52.818 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-08-03T10:55:52.874 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-08-03T10:55:52.874 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:52.874 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 108931 Links: 1 2021-08-03T10:55:52.875 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:52.875 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:52.875 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2021-08-03 10:41:06.741145299 +0000 2021-08-03T10:55:52.875 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2021-08-03 10:38:04.843974281 +0000 2021-08-03T10:55:52.876 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2021-08-03 10:38:04.843974281 +0000 2021-08-03T10:55:52.876 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2021-08-03T10:55:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2021-08-03T10:55:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2021-08-03T10:55:52.884 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000201812 s, 2.5 MB/s 2021-08-03T10:55:52.887 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-08-03T10:55:52.887 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:55:52.887 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/scratch_devs of=/dev/stdout 2021-08-03T10:55:52.903 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-08-03T10:55:52.903 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-08-03T10:55:52.957 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-08-03T10:55:52.958 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:52.958 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 111987 Links: 1 2021-08-03T10:55:52.958 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:52.958 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:52.959 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2021-08-03 10:41:01.669643089 +0000 2021-08-03T10:55:52.959 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2021-08-03 10:37:55.338020702 +0000 2021-08-03T10:55:52.959 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2021-08-03 10:37:55.338020702 +0000 2021-08-03T10:55:52.959 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2021-08-03T10:55:52.967 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2021-08-03T10:55:52.967 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2021-08-03T10:55:52.967 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000212246 s, 2.4 MB/s 2021-08-03T10:55:52.969 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-08-03T10:55:53.024 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-08-03T10:55:53.024 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:53.025 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 105383 Links: 1 2021-08-03T10:55:53.025 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:53.025 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:53.025 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2021-08-03 10:41:01.669643089 +0000 2021-08-03T10:55:53.026 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2021-08-03 10:37:55.675013926 +0000 2021-08-03T10:55:53.026 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2021-08-03 10:37:55.675013926 +0000 2021-08-03T10:55:53.026 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2021-08-03T10:55:53.033 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2021-08-03T10:55:53.033 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2021-08-03T10:55:53.034 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000213799 s, 2.4 MB/s 2021-08-03T10:55:53.036 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-08-03T10:55:53.090 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-08-03T10:55:53.090 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:53.091 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 110951 Links: 1 2021-08-03T10:55:53.091 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:53.091 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:53.091 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2021-08-03 10:41:01.669643089 +0000 2021-08-03T10:55:53.092 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2021-08-03 10:37:56.022006949 +0000 2021-08-03T10:55:53.092 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2021-08-03 10:37:56.022006949 +0000 2021-08-03T10:55:53.092 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2021-08-03T10:55:53.100 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2021-08-03T10:55:53.100 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2021-08-03T10:55:53.100 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000210356 s, 2.4 MB/s 2021-08-03T10:55:53.102 DEBUG:teuthology.orchestra.run.smithi101:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-08-03T10:55:53.157 INFO:teuthology.orchestra.run.smithi101.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-08-03T10:55:53.157 INFO:teuthology.orchestra.run.smithi101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-03T10:55:53.158 INFO:teuthology.orchestra.run.smithi101.stdout:Device: 6h/6d Inode: 106292 Links: 1 2021-08-03T10:55:53.158 INFO:teuthology.orchestra.run.smithi101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-03T10:55:53.158 INFO:teuthology.orchestra.run.smithi101.stdout:Context: system_u:object_r:device_t:s0 2021-08-03T10:55:53.158 INFO:teuthology.orchestra.run.smithi101.stdout:Access: 2021-08-03 10:41:01.669643089 +0000 2021-08-03T10:55:53.159 INFO:teuthology.orchestra.run.smithi101.stdout:Modify: 2021-08-03 10:37:56.376999811 +0000 2021-08-03T10:55:53.159 INFO:teuthology.orchestra.run.smithi101.stdout:Change: 2021-08-03 10:37:56.376999811 +0000 2021-08-03T10:55:53.159 INFO:teuthology.orchestra.run.smithi101.stdout: Birth: - 2021-08-03T10:55:53.166 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records in 2021-08-03T10:55:53.167 INFO:teuthology.orchestra.run.smithi101.stderr:1+0 records out 2021-08-03T10:55:53.167 INFO:teuthology.orchestra.run.smithi101.stderr:512 bytes copied, 0.000193656 s, 2.6 MB/s 2021-08-03T10:55:53.169 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-08-03T10:55:53.169 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi101.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-08-03T10:55:53.170 INFO:tasks.ceph:Generating config... 2021-08-03T10:55:53.172 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-08-03T10:55:53.172 INFO:tasks.ceph:[global] mon election default strategy = 3 2021-08-03T10:55:53.173 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2021-08-03T10:55:53.173 INFO:tasks.ceph:[global] ms type = async 2021-08-03T10:55:53.173 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2021-08-03T10:55:53.174 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-08-03T10:55:53.174 INFO:tasks.ceph:[mgr] debug ms = 1 2021-08-03T10:55:53.174 INFO:tasks.ceph:[mon] debug mon = 20 2021-08-03T10:55:53.175 INFO:tasks.ceph:[mon] debug ms = 1 2021-08-03T10:55:53.175 INFO:tasks.ceph:[mon] debug paxos = 20 2021-08-03T10:55:53.175 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2021-08-03T10:55:53.176 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2021-08-03T10:55:53.176 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2021-08-03T10:55:53.176 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2021-08-03T10:55:53.176 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2021-08-03T10:55:53.177 INFO:tasks.ceph:[mon] mon scrub interval = 300 2021-08-03T10:55:53.177 INFO:tasks.ceph:[mon] paxos service trim min = 10 2021-08-03T10:55:53.177 INFO:tasks.ceph:[osd] bdev async discard = True 2021-08-03T10:55:53.178 INFO:tasks.ceph:[osd] bdev enable discard = True 2021-08-03T10:55:53.178 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-08-03T10:55:53.178 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-08-03T10:55:53.179 INFO:tasks.ceph:[osd] debug bluefs = 1 2021-08-03T10:55:53.179 INFO:tasks.ceph:[osd] debug bluestore = 1 2021-08-03T10:55:53.179 INFO:tasks.ceph:[osd] debug monc = 20 2021-08-03T10:55:53.180 INFO:tasks.ceph:[osd] debug ms = 1 2021-08-03T10:55:53.180 INFO:tasks.ceph:[osd] debug osd = 20 2021-08-03T10:55:53.180 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-08-03T10:55:53.181 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-08-03T10:55:53.181 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-08-03T10:55:53.181 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-08-03T10:55:53.182 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2021-08-03T10:55:53.182 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2021-08-03T10:55:53.182 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-08-03T10:55:53.183 INFO:tasks.ceph:[osd] osd fast shutdown = False 2021-08-03T10:55:53.183 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2021-08-03T10:55:53.183 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2021-08-03T10:55:53.184 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-08-03T10:55:53.184 INFO:tasks.ceph:[osd] osd op queue = debug_random 2021-08-03T10:55:53.184 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2021-08-03T10:55:53.185 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2021-08-03T10:55:53.185 INFO:tasks.ceph:Setting up mon.a... 2021-08-03T10:55:53.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-08-03T10:55:53.272 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2021-08-03T10:55:53.275 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-08-03T10:55:53.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-08-03T10:55:53.382 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3'), ('mon.c', '[v2:172.21.15.3:3301,v1:172.21.15.3:6790]'), ('mon.b', '172.21.15.101')] 2021-08-03T10:55:53.382 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3,[v2:172.21.15.3:3301,v1:172.21.15.3:6790],172.21.15.101', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2021-08-03T10:55:53.384 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:53.384 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-08-03T10:55:53.437 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --addv c '[v2:172.21.15.3:3301,v1:172.21.15.3:6790]' --add b 172.21.15.101 --print /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:55:53.523 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:55:53.524 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid 03d513f3-0a93-4a0d-ad7b-451d7864f99d 2021-08-03T10:55:53.524 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = octopus 2021-08-03T10:55:53.524 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2021-08-03T10:55:53.525 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 03d513f3-0a93-4a0d-ad7b-451d7864f99d 2021-08-03T10:55:53.525 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2021-08-03T10:55:53.523539+0000 2021-08-03T10:55:53.525 INFO:teuthology.orchestra.run.smithi003.stdout:created 2021-08-03T10:55:53.523539+0000 2021-08-03T10:55:53.525 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 15 (octopus) 2021-08-03T10:55:53.525 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 3 2021-08-03T10:55:53.526 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2021-08-03T10:55:53.526 INFO:teuthology.orchestra.run.smithi003.stdout:1: [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] mon.b 2021-08-03T10:55:53.526 INFO:teuthology.orchestra.run.smithi003.stdout:2: [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] mon.c 2021-08-03T10:55:53.526 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-08-03T10:55:53.528 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-08-03T10:55:53.543 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 03d513f3-0a93-4a0d-ad7b-451d7864f99d... 2021-08-03T10:55:53.544 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-08-03T10:55:53.585 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-08-03T10:55:53.626 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2021-08-03T10:55:53.626 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2021-08-03T10:55:53.626 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-08-03T10:55:53.627 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2021-08-03T10:55:53.627 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.627 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2021-08-03T10:55:53.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.628 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2021-08-03T10:55:53.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.628 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2021-08-03T10:55:53.628 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2021-08-03T10:55:53.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.629 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2021-08-03T10:55:53.629 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2021-08-03T10:55:53.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.630 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2021-08-03T10:55:53.630 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2021-08-03T10:55:53.630 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.630 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2021-08-03T10:55:53.630 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2021-08-03T10:55:53.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.631 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2021-08-03T10:55:53.631 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.631 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2021-08-03T10:55:53.632 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2021-08-03T10:55:53.632 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2021-08-03T10:55:53.632 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2021-08-03T10:55:53.632 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2021-08-03T10:55:53.633 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2021-08-03T10:55:53.633 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2021-08-03T10:55:53.633 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-08-03T10:55:53.633 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2021-08-03T10:55:53.634 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2021-08-03T10:55:53.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.634 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-08-03T10:55:53.634 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.635 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2021-08-03T10:55:53.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.635 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2021-08-03T10:55:53.635 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.635 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2021-08-03T10:55:53.636 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2021-08-03T10:55:53.636 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2021-08-03T10:55:53.636 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = "172.21.15.3,[v2:172.21.15.3:3301,v1:172.21.15.3:6790],172.21.15.101" 2021-08-03T10:55:53.636 INFO:teuthology.orchestra.run.smithi003.stdout: mon client directed command retry = 5 2021-08-03T10:55:53.637 INFO:teuthology.orchestra.run.smithi003.stdout: mon election default strategy = 3 2021-08-03T10:55:53.637 INFO:teuthology.orchestra.run.smithi003.stdout: ms inject socket failures = 5000 2021-08-03T10:55:53.637 INFO:teuthology.orchestra.run.smithi003.stdout: ms type = async 2021-08-03T10:55:53.637 INFO:teuthology.orchestra.run.smithi003.stdout: osd heartbeat grace = 80 2021-08-03T10:55:53.638 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 03d513f3-0a93-4a0d-ad7b-451d7864f99d 2021-08-03T10:55:53.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.638 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2021-08-03T10:55:53.638 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2021-08-03T10:55:53.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.639 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2021-08-03T10:55:53.639 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2021-08-03T10:55:53.639 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.640 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2021-08-03T10:55:53.640 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2021-08-03T10:55:53.640 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.640 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2021-08-03T10:55:53.641 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2021-08-03T10:55:53.641 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2021-08-03T10:55:53.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.641 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2021-08-03T10:55:53.642 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2021-08-03T10:55:53.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.642 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2021-08-03T10:55:53.642 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.642 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2021-08-03T10:55:53.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.643 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2021-08-03T10:55:53.643 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.643 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2021-08-03T10:55:53.644 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2021-08-03T10:55:53.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.644 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2021-08-03T10:55:53.644 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2021-08-03T10:55:53.645 INFO:teuthology.orchestra.run.smithi003.stdout: bdev async discard = True 2021-08-03T10:55:53.645 INFO:teuthology.orchestra.run.smithi003.stdout: bdev enable discard = True 2021-08-03T10:55:53.645 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2021-08-03T10:55:53.645 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2021-08-03T10:55:53.646 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 1 2021-08-03T10:55:53.646 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 1 2021-08-03T10:55:53.646 INFO:teuthology.orchestra.run.smithi003.stdout: debug monc = 20 2021-08-03T10:55:53.646 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2021-08-03T10:55:53.647 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2021-08-03T10:55:53.647 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 10 2021-08-03T10:55:53.647 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2021-08-03T10:55:53.647 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2021-08-03T10:55:53.647 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2021-08-03T10:55:53.648 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify cached snaps = True 2021-08-03T10:55:53.648 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify missing on start = True 2021-08-03T10:55:53.648 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2021-08-03T10:55:53.648 INFO:teuthology.orchestra.run.smithi003.stdout: osd fast shutdown = False 2021-08-03T10:55:53.649 INFO:teuthology.orchestra.run.smithi003.stdout: osd max markdown count = 1000 2021-08-03T10:55:53.649 INFO:teuthology.orchestra.run.smithi003.stdout: osd memory target = 1610612736 2021-08-03T10:55:53.649 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2021-08-03T10:55:53.649 INFO:teuthology.orchestra.run.smithi003.stdout: osd op queue = debug_random 2021-08-03T10:55:53.650 INFO:teuthology.orchestra.run.smithi003.stdout: osd op queue cut off = debug_random 2021-08-03T10:55:53.650 INFO:teuthology.orchestra.run.smithi003.stdout: osd shutdown pgref assert = True 2021-08-03T10:55:53.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.650 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2021-08-03T10:55:53.651 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2021-08-03T10:55:53.651 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2021-08-03T10:55:53.651 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2021-08-03T10:55:53.651 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2021-08-03T10:55:53.652 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2021-08-03T10:55:53.652 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2021-08-03T10:55:53.652 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2021-08-03T10:55:53.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.652 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2021-08-03T10:55:53.653 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2021-08-03T10:55:53.653 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2021-08-03T10:55:53.653 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2021-08-03T10:55:53.653 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2021-08-03T10:55:53.654 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2021-08-03T10:55:53.654 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2021-08-03T10:55:53.654 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2021-08-03T10:55:53.654 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2021-08-03T10:55:53.655 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2021-08-03T10:55:53.655 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2021-08-03T10:55:53.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.655 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-08-03T10:55:53.656 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2021-08-03T10:55:53.656 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2021-08-03T10:55:53.656 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.656 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2021-08-03T10:55:53.656 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-08-03T10:55:53.657 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-08-03T10:55:53.657 INFO:teuthology.orchestra.run.smithi003.stdout: mon min osdmap epochs = 50 2021-08-03T10:55:53.657 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd crush smoke test = False 2021-08-03T10:55:53.657 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune interval = 2 2021-08-03T10:55:53.658 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune min = 15 2021-08-03T10:55:53.658 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune txsize = 2 2021-08-03T10:55:53.658 INFO:teuthology.orchestra.run.smithi003.stdout: mon scrub interval = 300 2021-08-03T10:55:53.658 INFO:teuthology.orchestra.run.smithi003.stdout: paxos service trim min = 10 2021-08-03T10:55:53.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2021-08-03T10:55:53.659 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2021-08-03T10:55:53.659 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2021-08-03T10:55:53.659 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2021-08-03T10:55:53.660 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2021-08-03T10:55:53.660 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-08-03T10:55:53.660 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-08-03T10:55:53.661 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2021-08-03T10:55:53.661 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.c] 2021-08-03T10:55:53.661 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.b] 2021-08-03T10:55:53.663 INFO:teuthology.orchestra.run.smithi101.stdout:[global] 2021-08-03T10:55:53.663 INFO:teuthology.orchestra.run.smithi101.stdout: chdir = "" 2021-08-03T10:55:53.663 INFO:teuthology.orchestra.run.smithi101.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-08-03T10:55:53.664 INFO:teuthology.orchestra.run.smithi101.stdout: auth supported = cephx 2021-08-03T10:55:53.664 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.664 INFO:teuthology.orchestra.run.smithi101.stdout: filestore xattr use omap = true 2021-08-03T10:55:53.664 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.665 INFO:teuthology.orchestra.run.smithi101.stdout: mon clock drift allowed = 1.000 2021-08-03T10:55:53.665 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.665 INFO:teuthology.orchestra.run.smithi101.stdout: osd crush chooseleaf type = 0 2021-08-03T10:55:53.665 INFO:teuthology.orchestra.run.smithi101.stdout: auth debug = true 2021-08-03T10:55:53.666 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.666 INFO:teuthology.orchestra.run.smithi101.stdout: ms die on old message = true 2021-08-03T10:55:53.666 INFO:teuthology.orchestra.run.smithi101.stdout: ms die on bug = true 2021-08-03T10:55:53.666 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.667 INFO:teuthology.orchestra.run.smithi101.stdout: mon max pg per osd = 10000 # >= luminous 2021-08-03T10:55:53.667 INFO:teuthology.orchestra.run.smithi101.stdout: mon pg warn max object skew = 0 2021-08-03T10:55:53.667 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.667 INFO:teuthology.orchestra.run.smithi101.stdout: # disable pg_autoscaler by default for new pools 2021-08-03T10:55:53.668 INFO:teuthology.orchestra.run.smithi101.stdout: osd_pool_default_pg_autoscale_mode = off 2021-08-03T10:55:53.668 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.668 INFO:teuthology.orchestra.run.smithi101.stdout: osd pool default size = 2 2021-08-03T10:55:53.668 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.668 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd allow primary affinity = true 2021-08-03T10:55:53.669 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd allow pg remap = true 2021-08-03T10:55:53.669 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on legacy crush tunables = false 2021-08-03T10:55:53.669 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on crush straw calc version zero = false 2021-08-03T10:55:53.669 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on no sortbitwise = false 2021-08-03T10:55:53.670 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on osd down out interval zero = false 2021-08-03T10:55:53.670 INFO:teuthology.orchestra.run.smithi101.stdout: mon warn on too few osds = false 2021-08-03T10:55:53.670 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-08-03T10:55:53.670 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_pool_no_redundancy = false 2021-08-03T10:55:53.671 INFO:teuthology.orchestra.run.smithi101.stdout: mon_allow_pool_size_one = true 2021-08-03T10:55:53.671 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.671 INFO:teuthology.orchestra.run.smithi101.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-08-03T10:55:53.671 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.672 INFO:teuthology.orchestra.run.smithi101.stdout: osd default data pool replay window = 5 2021-08-03T10:55:53.672 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.672 INFO:teuthology.orchestra.run.smithi101.stdout: mon allow pool delete = true 2021-08-03T10:55:53.672 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.673 INFO:teuthology.orchestra.run.smithi101.stdout: mon cluster log file level = debug 2021-08-03T10:55:53.673 INFO:teuthology.orchestra.run.smithi101.stdout: debug asserts on shutdown = true 2021-08-03T10:55:53.673 INFO:teuthology.orchestra.run.smithi101.stdout: mon health detail to clog = false 2021-08-03T10:55:53.673 INFO:teuthology.orchestra.run.smithi101.stdout: mon host = "172.21.15.3,[v2:172.21.15.3:3301,v1:172.21.15.3:6790],172.21.15.101" 2021-08-03T10:55:53.673 INFO:teuthology.orchestra.run.smithi101.stdout: mon client directed command retry = 5 2021-08-03T10:55:53.674 INFO:teuthology.orchestra.run.smithi101.stdout: mon election default strategy = 3 2021-08-03T10:55:53.674 INFO:teuthology.orchestra.run.smithi101.stdout: ms inject socket failures = 5000 2021-08-03T10:55:53.674 INFO:teuthology.orchestra.run.smithi101.stdout: ms type = async 2021-08-03T10:55:53.674 INFO:teuthology.orchestra.run.smithi101.stdout: osd heartbeat grace = 80 2021-08-03T10:55:53.675 INFO:teuthology.orchestra.run.smithi101.stdout: fsid = 03d513f3-0a93-4a0d-ad7b-451d7864f99d 2021-08-03T10:55:53.675 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.675 INFO:teuthology.orchestra.run.smithi101.stdout:[osd] 2021-08-03T10:55:53.675 INFO:teuthology.orchestra.run.smithi101.stdout: osd journal size = 100 2021-08-03T10:55:53.676 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.676 INFO:teuthology.orchestra.run.smithi101.stdout: osd scrub load threshold = 5.0 2021-08-03T10:55:53.676 INFO:teuthology.orchestra.run.smithi101.stdout: osd scrub max interval = 600 2021-08-03T10:55:53.676 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.677 INFO:teuthology.orchestra.run.smithi101.stdout: osd recover clone overlap = true 2021-08-03T10:55:53.677 INFO:teuthology.orchestra.run.smithi101.stdout: osd recovery max chunk = 1048576 2021-08-03T10:55:53.677 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.677 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug shutdown = true 2021-08-03T10:55:53.677 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug op order = true 2021-08-03T10:55:53.678 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug verify stray on activate = true 2021-08-03T10:55:53.678 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.678 INFO:teuthology.orchestra.run.smithi101.stdout: osd open classes on start = true 2021-08-03T10:55:53.678 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug pg log writeout = true 2021-08-03T10:55:53.679 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.679 INFO:teuthology.orchestra.run.smithi101.stdout: osd deep scrub update digest min age = 30 2021-08-03T10:55:53.679 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.679 INFO:teuthology.orchestra.run.smithi101.stdout: osd map max advance = 10 2021-08-03T10:55:53.680 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.680 INFO:teuthology.orchestra.run.smithi101.stdout: journal zero on create = true 2021-08-03T10:55:53.680 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.680 INFO:teuthology.orchestra.run.smithi101.stdout: filestore ondisk finisher threads = 3 2021-08-03T10:55:53.681 INFO:teuthology.orchestra.run.smithi101.stdout: filestore apply finisher threads = 3 2021-08-03T10:55:53.681 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.681 INFO:teuthology.orchestra.run.smithi101.stdout: bdev debug aio = true 2021-08-03T10:55:53.681 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug misdirected ops = true 2021-08-03T10:55:53.682 INFO:teuthology.orchestra.run.smithi101.stdout: bdev async discard = True 2021-08-03T10:55:53.682 INFO:teuthology.orchestra.run.smithi101.stdout: bdev enable discard = True 2021-08-03T10:55:53.682 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore block size = 96636764160 2021-08-03T10:55:53.682 INFO:teuthology.orchestra.run.smithi101.stdout: bluestore fsck on mount = True 2021-08-03T10:55:53.682 INFO:teuthology.orchestra.run.smithi101.stdout: debug bluefs = 1 2021-08-03T10:55:53.683 INFO:teuthology.orchestra.run.smithi101.stdout: debug bluestore = 1 2021-08-03T10:55:53.683 INFO:teuthology.orchestra.run.smithi101.stdout: debug monc = 20 2021-08-03T10:55:53.683 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2021-08-03T10:55:53.684 INFO:teuthology.orchestra.run.smithi101.stdout: debug osd = 20 2021-08-03T10:55:53.684 INFO:teuthology.orchestra.run.smithi101.stdout: debug rocksdb = 10 2021-08-03T10:55:53.684 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd backfillfull_ratio = 0.85 2021-08-03T10:55:53.684 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd full ratio = 0.9 2021-08-03T10:55:53.684 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd nearfull ratio = 0.8 2021-08-03T10:55:53.685 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug verify cached snaps = True 2021-08-03T10:55:53.685 INFO:teuthology.orchestra.run.smithi101.stdout: osd debug verify missing on start = True 2021-08-03T10:55:53.685 INFO:teuthology.orchestra.run.smithi101.stdout: osd failsafe full ratio = 0.95 2021-08-03T10:55:53.685 INFO:teuthology.orchestra.run.smithi101.stdout: osd fast shutdown = False 2021-08-03T10:55:53.686 INFO:teuthology.orchestra.run.smithi101.stdout: osd max markdown count = 1000 2021-08-03T10:55:53.686 INFO:teuthology.orchestra.run.smithi101.stdout: osd memory target = 1610612736 2021-08-03T10:55:53.686 INFO:teuthology.orchestra.run.smithi101.stdout: osd objectstore = bluestore 2021-08-03T10:55:53.686 INFO:teuthology.orchestra.run.smithi101.stdout: osd op queue = debug_random 2021-08-03T10:55:53.687 INFO:teuthology.orchestra.run.smithi101.stdout: osd op queue cut off = debug_random 2021-08-03T10:55:53.687 INFO:teuthology.orchestra.run.smithi101.stdout: osd shutdown pgref assert = True 2021-08-03T10:55:53.687 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.687 INFO:teuthology.orchestra.run.smithi101.stdout:[mgr] 2021-08-03T10:55:53.688 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2021-08-03T10:55:53.688 INFO:teuthology.orchestra.run.smithi101.stdout: debug mgr = 20 2021-08-03T10:55:53.688 INFO:teuthology.orchestra.run.smithi101.stdout: debug mon = 20 2021-08-03T10:55:53.688 INFO:teuthology.orchestra.run.smithi101.stdout: debug auth = 20 2021-08-03T10:55:53.689 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min pgs per osd = 4 2021-08-03T10:55:53.689 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min bytes per osd = 10 2021-08-03T10:55:53.689 INFO:teuthology.orchestra.run.smithi101.stdout: mgr/telemetry/nag = false 2021-08-03T10:55:53.689 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.690 INFO:teuthology.orchestra.run.smithi101.stdout:[mon] 2021-08-03T10:55:53.690 INFO:teuthology.orchestra.run.smithi101.stdout: debug ms = 1 2021-08-03T10:55:53.690 INFO:teuthology.orchestra.run.smithi101.stdout: debug mon = 20 2021-08-03T10:55:53.690 INFO:teuthology.orchestra.run.smithi101.stdout: debug paxos = 20 2021-08-03T10:55:53.691 INFO:teuthology.orchestra.run.smithi101.stdout: debug auth = 20 2021-08-03T10:55:53.691 INFO:teuthology.orchestra.run.smithi101.stdout: mon data avail warn = 5 2021-08-03T10:55:53.691 INFO:teuthology.orchestra.run.smithi101.stdout: mon mgr mkfs grace = 240 2021-08-03T10:55:53.691 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min pgs per osd = 4 2021-08-03T10:55:53.691 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd reporter subtree level = osd 2021-08-03T10:55:53.692 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd prime pg temp = true 2021-08-03T10:55:53.692 INFO:teuthology.orchestra.run.smithi101.stdout: mon reweight min bytes per osd = 10 2021-08-03T10:55:53.692 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.692 INFO:teuthology.orchestra.run.smithi101.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-08-03T10:55:53.693 INFO:teuthology.orchestra.run.smithi101.stdout: auth mon ticket ttl = 660 # 11m 2021-08-03T10:55:53.693 INFO:teuthology.orchestra.run.smithi101.stdout: auth service ticket ttl = 240 # 4m 2021-08-03T10:55:53.693 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.693 INFO:teuthology.orchestra.run.smithi101.stdout: # don't complain about insecure global_id in the test suite 2021-08-03T10:55:53.694 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-08-03T10:55:53.694 INFO:teuthology.orchestra.run.smithi101.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-08-03T10:55:53.694 INFO:teuthology.orchestra.run.smithi101.stdout: mon min osdmap epochs = 50 2021-08-03T10:55:53.694 INFO:teuthology.orchestra.run.smithi101.stdout: mon osd crush smoke test = False 2021-08-03T10:55:53.695 INFO:teuthology.orchestra.run.smithi101.stdout: mon osdmap full prune interval = 2 2021-08-03T10:55:53.695 INFO:teuthology.orchestra.run.smithi101.stdout: mon osdmap full prune min = 15 2021-08-03T10:55:53.695 INFO:teuthology.orchestra.run.smithi101.stdout: mon osdmap full prune txsize = 2 2021-08-03T10:55:53.695 INFO:teuthology.orchestra.run.smithi101.stdout: mon scrub interval = 300 2021-08-03T10:55:53.695 INFO:teuthology.orchestra.run.smithi101.stdout: paxos service trim min = 10 2021-08-03T10:55:53.696 INFO:teuthology.orchestra.run.smithi101.stdout: 2021-08-03T10:55:53.696 INFO:teuthology.orchestra.run.smithi101.stdout:[client] 2021-08-03T10:55:53.696 INFO:teuthology.orchestra.run.smithi101.stdout: rgw cache enabled = true 2021-08-03T10:55:53.696 INFO:teuthology.orchestra.run.smithi101.stdout: rgw enable ops log = true 2021-08-03T10:55:53.697 INFO:teuthology.orchestra.run.smithi101.stdout: rgw enable usage log = true 2021-08-03T10:55:53.697 INFO:teuthology.orchestra.run.smithi101.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-08-03T10:55:53.697 INFO:teuthology.orchestra.run.smithi101.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-08-03T10:55:53.697 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.a] 2021-08-03T10:55:53.698 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.c] 2021-08-03T10:55:53.698 INFO:teuthology.orchestra.run.smithi101.stdout:[mon.b] 2021-08-03T10:55:53.698 INFO:tasks.ceph:Creating admin key on mon.a... 2021-08-03T10:55:53.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-08-03T10:55:53.759 INFO:tasks.ceph:Copying monmap to all nodes... 2021-08-03T10:55:53.760 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:53.760 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-08-03T10:55:53.775 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:53.775 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-08-03T10:55:53.829 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:55:53.830 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:53.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2021-08-03T10:55:53.831 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-08-03T10:55:53.905 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:55:53.906 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:55:53.959 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:55:53.960 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:55:53.960 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd of=/etc/ceph/ceph.keyring 2021-08-03T10:55:53.961 DEBUG:teuthology.orchestra.run.smithi101:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-08-03T10:55:53.997 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:55:53.997 DEBUG:teuthology.orchestra.run.smithi101:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:55:54.052 INFO:tasks.ceph:Setting up mon nodes... 2021-08-03T10:55:54.052 INFO:tasks.ceph:Setting up mgr nodes... 2021-08-03T10:55:54.053 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-08-03T10:55:54.102 INFO:teuthology.orchestra.run.smithi003.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-08-03T10:55:54.105 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-08-03T10:55:54.185 INFO:teuthology.orchestra.run.smithi101.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-08-03T10:55:54.187 INFO:tasks.ceph:Setting up mds nodes... 2021-08-03T10:55:54.188 INFO:tasks.ceph_client:Setting up client nodes... 2021-08-03T10:55:54.188 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-08-03T10:55:54.229 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-08-03T10:55:54.242 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-08-03T10:55:54.281 INFO:teuthology.orchestra.run.smithi101.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-08-03T10:55:54.294 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-08-03T10:55:54.295 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi101.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-08-03T10:55:54.295 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-08-03T10:55:54.320 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-08-03T10:55:54.320 INFO:tasks.ceph:role: osd.0 2021-08-03T10:55:54.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:55:54.321 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-08-03T10:55:54.391 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:55:54.392 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:55:54.392 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:55:54.392 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2021-08-03T10:55:54.393 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:55:54.393 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:55:54.393 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:55:54.393 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:55:54.393 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:55:54.394 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:55:54.755 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2021-08-03T10:55:54.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2021-08-03T10:55:54.758 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-08-03T10:55:54.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-08-03T10:55:54.913 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-08-03T10:55:54.978 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-08-03T10:55:54.979 INFO:tasks.ceph:role: osd.1 2021-08-03T10:55:54.979 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:55:54.980 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-08-03T10:55:55.051 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:55:55.051 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:55:55.051 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:55:55.051 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2021-08-03T10:55:55.052 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:55:55.052 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:55:55.052 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:55:55.052 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:55:55.053 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:55:55.053 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:55:55.412 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2021-08-03T10:55:55.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2021-08-03T10:55:55.414 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-08-03T10:55:55.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-08-03T10:55:55.541 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-08-03T10:55:55.605 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-08-03T10:55:55.606 INFO:tasks.ceph:role: osd.2 2021-08-03T10:55:55.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:55:55.606 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-08-03T10:55:55.678 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:55:55.678 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:55:55.678 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:55:55.679 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2021-08-03T10:55:55.679 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:55:55.679 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:55:55.679 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:55:55.680 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:55:55.680 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:55:55.680 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:55:56.049 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2021-08-03T10:55:56.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2021-08-03T10:55:56.052 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-08-03T10:55:56.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-08-03T10:55:56.183 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-08-03T10:55:56.249 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-08-03T10:55:56.249 INFO:tasks.ceph:role: osd.3 2021-08-03T10:55:56.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com 2021-08-03T10:55:56.250 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-08-03T10:55:56.321 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:55:56.322 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:55:56.322 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:55:56.322 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 2021-08-03T10:55:56.322 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:55:56.323 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:55:56.323 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:55:56.323 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:55:56.324 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:55:56.324 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:55:56.693 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2021-08-03T10:55:56.695 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2021-08-03T10:55:56.696 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-08-03T10:55:56.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-08-03T10:55:56.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:55:56.927 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:56.926+0000 7f130abd20c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-08-03T10:55:56.930 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:56.929+0000 7f130abd20c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-08-03T10:55:56.930 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:56.929+0000 7f130abd20c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-08-03T10:55:56.931 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:56.929+0000 7f130abd20c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-08-03T10:55:56.931 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:56.929+0000 7f130abd20c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-08-03T10:55:56.932 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:56.931+0000 7f130abd20c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-08-03T10:55:59.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-08-03T10:55:59.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:55:59.913 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:59.910+0000 7f1f3b4c30c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-08-03T10:55:59.914 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:59.911+0000 7f1f3b4c30c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-08-03T10:55:59.914 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:59.911+0000 7f1f3b4c30c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-08-03T10:55:59.914 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:59.911+0000 7f1f3b4c30c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-08-03T10:55:59.915 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:59.911+0000 7f1f3b4c30c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-08-03T10:55:59.915 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:55:59.911+0000 7f1f3b4c30c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-08-03T10:56:02.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-08-03T10:56:02.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:02.891+0000 7fcf8b5630c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-08-03T10:56:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:02.891+0000 7fcf8b5630c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-08-03T10:56:02.894 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:02.891+0000 7fcf8b5630c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-08-03T10:56:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:02.891+0000 7fcf8b5630c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-08-03T10:56:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:02.891+0000 7fcf8b5630c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-08-03T10:56:02.895 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:02.892+0000 7fcf8b5630c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-08-03T10:56:05.757 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-08-03T10:56:05.787 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:05.877 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:05.875+0000 7fc3ce3dd0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-08-03T10:56:05.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:05.875+0000 7fc3ce3dd0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-08-03T10:56:05.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:05.875+0000 7fc3ce3dd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-08-03T10:56:05.878 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:05.875+0000 7fc3ce3dd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-08-03T10:56:05.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:05.875+0000 7fc3ce3dd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-08-03T10:56:05.879 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T10:56:05.876+0000 7fc3ce3dd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-08-03T10:56:08.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-08-03T10:56:08.766 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-08-03T10:56:08.795 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-08-03T10:56:08.795 INFO:tasks.ceph:role: osd.4 2021-08-03T10:56:08.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:56:08.796 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-08-03T10:56:08.870 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:56:08.871 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:56:08.871 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:56:08.871 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 2021-08-03T10:56:08.871 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:56:08.872 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:56:08.872 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:56:08.872 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:56:08.872 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:56:08.872 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:56:09.232 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2021-08-03T10:56:09.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2021-08-03T10:56:09.234 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-08-03T10:56:09.368 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-08-03T10:56:09.398 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-08-03T10:56:09.462 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-08-03T10:56:09.462 INFO:tasks.ceph:role: osd.5 2021-08-03T10:56:09.463 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:56:09.463 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-08-03T10:56:09.534 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:56:09.534 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:56:09.534 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:56:09.535 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 2021-08-03T10:56:09.535 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:56:09.535 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:56:09.536 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:56:09.536 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:56:09.536 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:56:09.537 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:56:09.891 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2021-08-03T10:56:09.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2021-08-03T10:56:09.893 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-08-03T10:56:09.997 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-08-03T10:56:10.026 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-08-03T10:56:10.091 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-08-03T10:56:10.091 INFO:tasks.ceph:role: osd.6 2021-08-03T10:56:10.092 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:56:10.092 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-08-03T10:56:10.163 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:56:10.163 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:56:10.163 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:56:10.163 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 2021-08-03T10:56:10.164 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:56:10.164 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:56:10.164 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:56:10.164 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:56:10.165 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:56:10.165 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:56:10.534 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2021-08-03T10:56:10.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2021-08-03T10:56:10.536 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-08-03T10:56:10.658 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-08-03T10:56:10.687 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-08-03T10:56:10.752 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-08-03T10:56:10.752 INFO:tasks.ceph:role: osd.7 2021-08-03T10:56:10.752 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi101.front.sepia.ceph.com 2021-08-03T10:56:10.753 DEBUG:teuthology.orchestra.run.smithi101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-08-03T10:56:10.824 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-08-03T10:56:10.825 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-03T10:56:10.825 INFO:teuthology.orchestra.run.smithi101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-03T10:56:10.825 INFO:teuthology.orchestra.run.smithi101.stdout: = reflink=1 2021-08-03T10:56:10.825 INFO:teuthology.orchestra.run.smithi101.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-03T10:56:10.826 INFO:teuthology.orchestra.run.smithi101.stdout: = sunit=0 swidth=0 blks 2021-08-03T10:56:10.826 INFO:teuthology.orchestra.run.smithi101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-03T10:56:10.826 INFO:teuthology.orchestra.run.smithi101.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-03T10:56:10.826 INFO:teuthology.orchestra.run.smithi101.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-03T10:56:10.827 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-03T10:56:11.197 INFO:teuthology.orchestra.run.smithi101.stdout:Discarding blocks...Done. 2021-08-03T10:56:11.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi101.front.sepia.ceph.com -o noatime 2021-08-03T10:56:11.200 DEBUG:teuthology.orchestra.run.smithi101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-08-03T10:56:11.322 DEBUG:teuthology.orchestra.run.smithi101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-08-03T10:56:11.351 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:11.661 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:11.660+0000 7fb49a9bd0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-08-03T10:56:11.664 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:11.663+0000 7fb49a9bd0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-08-03T10:56:11.664 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:11.663+0000 7fb49a9bd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-08-03T10:56:11.664 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:11.663+0000 7fb49a9bd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-08-03T10:56:11.664 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:11.663+0000 7fb49a9bd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-08-03T10:56:11.667 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:11.666+0000 7fb49a9bd0c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-08-03T10:56:14.531 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-08-03T10:56:14.560 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:14.658 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:14.656+0000 7ff7d40320c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-08-03T10:56:14.659 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:14.656+0000 7ff7d40320c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-08-03T10:56:14.659 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:14.656+0000 7ff7d40320c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-08-03T10:56:14.659 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:14.656+0000 7ff7d40320c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-08-03T10:56:14.660 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:14.656+0000 7ff7d40320c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-08-03T10:56:14.660 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:14.657+0000 7ff7d40320c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-08-03T10:56:17.515 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-08-03T10:56:17.584 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:17.672 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:17.670+0000 7f6b18e8c0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-08-03T10:56:17.672 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:17.671+0000 7f6b18e8c0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-08-03T10:56:17.673 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:17.671+0000 7f6b18e8c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-08-03T10:56:17.673 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:17.671+0000 7f6b18e8c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-08-03T10:56:17.673 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:17.671+0000 7f6b18e8c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-08-03T10:56:17.673 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:17.671+0000 7f6b18e8c0c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-08-03T10:56:20.526 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-08-03T10:56:20.553 DEBUG:teuthology.orchestra.run.smithi101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:20.638 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:20.637+0000 7fab3c9cb0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-08-03T10:56:20.639 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:20.637+0000 7fab3c9cb0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-08-03T10:56:20.639 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:20.637+0000 7fab3c9cb0c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-08-03T10:56:20.640 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:20.637+0000 7fab3c9cb0c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-08-03T10:56:20.640 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:20.637+0000 7fab3c9cb0c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-08-03T10:56:20.640 INFO:teuthology.orchestra.run.smithi101.stderr:2021-08-03T10:56:20.638+0000 7fab3c9cb0c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-08-03T10:56:23.498 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-08-03T10:56:23.526 INFO:tasks.ceph:Reading keys from all nodes... 2021-08-03T10:56:23.527 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:23.527 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2021-08-03T10:56:23.558 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:23.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-08-03T10:56:23.626 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:23.626 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-08-03T10:56:23.693 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:23.694 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-08-03T10:56:23.759 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:23.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-08-03T10:56:23.827 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:23.827 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-08-03T10:56:23.855 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:23.856 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-08-03T10:56:23.922 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:23.922 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-08-03T10:56:23.988 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:23.988 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2021-08-03T10:56:24.054 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:24.054 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2021-08-03T10:56:24.119 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:24.119 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-08-03T10:56:24.137 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:24.138 DEBUG:teuthology.orchestra.run.smithi101:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2021-08-03T10:56:24.174 INFO:tasks.ceph:Adding keys to all mons... 2021-08-03T10:56:24.174 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2021-08-03T10:56:24.180 DEBUG:teuthology.orchestra.run.smithi101:> sudo tee -a /etc/ceph/ceph.keyring 2021-08-03T10:56:24.217 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.y] 2021-08-03T10:56:24.217 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQC6IAlhQDYcBhAAZXIy08grC/+glTVjxPcvDw== 2021-08-03T10:56:24.218 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2021-08-03T10:56:24.218 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQC8IAlhXLdJNxAAi1wSlKctroJ1EHxL9RugqQ== 2021-08-03T10:56:24.219 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2021-08-03T10:56:24.219 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQC/IAlhItRmNhAAi295UD/f/oUVI5Rbln34qg== 2021-08-03T10:56:24.220 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2021-08-03T10:56:24.220 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDCIAlhAaxBNRAADy9YD0lNKFT5LST9mQMsqA== 2021-08-03T10:56:24.220 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2021-08-03T10:56:24.221 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDFIAlh4nFKNBAARzFjTqFzmuGkRnVjmBCfBA== 2021-08-03T10:56:24.221 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2021-08-03T10:56:24.221 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQC6IAlhOTkNCxAAo9Oz9MEK2MII4sPjELaoUA== 2021-08-03T10:56:24.221 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.4] 2021-08-03T10:56:24.221 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDLIAlhJkhoJxAA8GMxVZJU5XPXNCJnEvsuxA== 2021-08-03T10:56:24.222 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.5] 2021-08-03T10:56:24.222 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDOIAlh+uMuJxAASEpPZyQVns9SaK5rJv9C6A== 2021-08-03T10:56:24.222 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.6] 2021-08-03T10:56:24.222 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDRIAlhY+oKKBAAReGNlaOQwVvzt35VCbCZVQ== 2021-08-03T10:56:24.222 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.7] 2021-08-03T10:56:24.223 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDUIAlhVzwLJhAAAXKK3OEwLTY9UHGszFVXjQ== 2021-08-03T10:56:24.223 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2021-08-03T10:56:24.223 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQC6IAlhY5OvDRAAgdmeWLzj1deYN/jEDRyAdg== 2021-08-03T10:56:24.223 INFO:teuthology.orchestra.run.smithi003.stdout:[client.1] 2021-08-03T10:56:24.223 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQC6IAlhRlHAEBAAcD6VRCSbgUsDHtSMQw45vQ== 2021-08-03T10:56:24.237 INFO:teuthology.orchestra.run.smithi101.stdout:[mgr.y] 2021-08-03T10:56:24.237 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQC6IAlhQDYcBhAAZXIy08grC/+glTVjxPcvDw== 2021-08-03T10:56:24.237 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.0] 2021-08-03T10:56:24.238 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQC8IAlhXLdJNxAAi1wSlKctroJ1EHxL9RugqQ== 2021-08-03T10:56:24.238 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.1] 2021-08-03T10:56:24.238 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQC/IAlhItRmNhAAi295UD/f/oUVI5Rbln34qg== 2021-08-03T10:56:24.238 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.2] 2021-08-03T10:56:24.239 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQDCIAlhAaxBNRAADy9YD0lNKFT5LST9mQMsqA== 2021-08-03T10:56:24.239 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.3] 2021-08-03T10:56:24.239 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQDFIAlh4nFKNBAARzFjTqFzmuGkRnVjmBCfBA== 2021-08-03T10:56:24.239 INFO:teuthology.orchestra.run.smithi101.stdout:[mgr.x] 2021-08-03T10:56:24.239 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQC6IAlhOTkNCxAAo9Oz9MEK2MII4sPjELaoUA== 2021-08-03T10:56:24.240 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.4] 2021-08-03T10:56:24.240 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQDLIAlhJkhoJxAA8GMxVZJU5XPXNCJnEvsuxA== 2021-08-03T10:56:24.240 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.5] 2021-08-03T10:56:24.240 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQDOIAlh+uMuJxAASEpPZyQVns9SaK5rJv9C6A== 2021-08-03T10:56:24.241 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.6] 2021-08-03T10:56:24.241 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQDRIAlhY+oKKBAAReGNlaOQwVvzt35VCbCZVQ== 2021-08-03T10:56:24.241 INFO:teuthology.orchestra.run.smithi101.stdout:[osd.7] 2021-08-03T10:56:24.241 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQDUIAlhVzwLJhAAAXKK3OEwLTY9UHGszFVXjQ== 2021-08-03T10:56:24.242 INFO:teuthology.orchestra.run.smithi101.stdout:[client.0] 2021-08-03T10:56:24.242 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQC6IAlhY5OvDRAAgdmeWLzj1deYN/jEDRyAdg== 2021-08-03T10:56:24.243 INFO:teuthology.orchestra.run.smithi101.stdout:[client.1] 2021-08-03T10:56:24.243 INFO:teuthology.orchestra.run.smithi101.stdout: key = AQC6IAlhRlHAEBAAcD6VRCSbgUsDHtSMQw45vQ== 2021-08-03T10:56:24.244 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-08-03T10:56:24.267 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-08-03T10:56:24.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.338 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.389 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.392 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.442 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.444 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.496 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.546 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-08-03T10:56:24.549 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-08-03T10:56:24.598 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.601 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.651 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.654 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.705 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.755 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.757 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-03T10:56:24.807 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-08-03T10:56:24.810 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-08-03T10:56:24.863 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-08-03T10:56:24.866 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-08-03T10:56:24.920 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-08-03T10:56:24.920 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-08-03T10:56:24.945 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-08-03T10:56:25.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-08-03T10:56:25.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-08-03T10:56:25.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-08-03T10:56:25.234 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-08-03T10:56:25.259 DEBUG:teuthology.orchestra.run.smithi101:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-08-03T10:56:25.285 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-08-03T10:56:25.381 DEBUG:teuthology.orchestra.run.smithi101:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-08-03T10:56:25.405 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:25.408 DEBUG:teuthology.orchestra.run.smithi101:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-08-03T10:56:25.459 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-08-03T10:56:25.459 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2021-08-03T10:56:25.460 INFO:tasks.ceph.mon.a:Restarting daemon 2021-08-03T10:56:25.460 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2021-08-03T10:56:25.463 INFO:tasks.ceph.mon.a:Started 2021-08-03T10:56:25.463 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2021-08-03T10:56:25.464 INFO:tasks.ceph.mon.c:Restarting daemon 2021-08-03T10:56:25.464 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2021-08-03T10:56:25.466 INFO:tasks.ceph.mon.c:Started 2021-08-03T10:56:25.467 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2021-08-03T10:56:25.467 INFO:tasks.ceph.mon.b:Restarting daemon 2021-08-03T10:56:25.468 DEBUG:teuthology.orchestra.run.smithi101:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2021-08-03T10:56:25.501 INFO:tasks.ceph.mon.b:Started 2021-08-03T10:56:25.501 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-08-03T10:56:25.502 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-08-03T10:56:25.502 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2021-08-03T10:56:25.504 INFO:tasks.ceph.mgr.y:Started 2021-08-03T10:56:25.505 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-08-03T10:56:25.505 DEBUG:teuthology.orchestra.run.smithi101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2021-08-03T10:56:25.507 INFO:tasks.ceph.mgr.x:Started 2021-08-03T10:56:25.508 INFO:tasks.ceph:Setting crush tunables to default 2021-08-03T10:56:25.508 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2021-08-03T10:56:34.871 INFO:tasks.ceph.mon.b.smithi101.stderr:==00:00:00:09.265 33958== Warning: unimplemented fcntl command: 1036 2021-08-03T10:56:35.614 INFO:tasks.ceph.mon.b.smithi101.stderr:==00:00:00:10.009 33958== Warning: unimplemented fcntl command: 1036 2021-08-03T10:56:35.722 INFO:tasks.ceph.mon.a.smithi003.stderr:==00:00:00:10.133 34328== Warning: unimplemented fcntl command: 1036 2021-08-03T10:56:35.723 INFO:tasks.ceph.mon.c.smithi003.stderr:==00:00:00:10.135 34334== Warning: unimplemented fcntl command: 1036 2021-08-03T10:56:36.521 INFO:tasks.ceph.mon.a.smithi003.stderr:==00:00:00:10.933 34328== Warning: unimplemented fcntl command: 1036 2021-08-03T10:56:36.525 INFO:tasks.ceph.mon.c.smithi003.stderr:==00:00:00:10.937 34334== Warning: unimplemented fcntl command: 1036 2021-08-03T10:56:49.910 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2021-08-03T10:56:49.923 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-08-03T10:56:49.924 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:49.924 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-08-03T10:56:49.951 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:49.952 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-08-03T10:56:50.019 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:50.019 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-08-03T10:56:50.084 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2021-08-03T10:56:50.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-08-03T10:56:50.152 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:50.152 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-08-03T10:56:50.177 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:50.178 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-08-03T10:56:50.241 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:50.242 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2021-08-03T10:56:50.306 DEBUG:teuthology.orchestra.run.smithi101:> set -ex 2021-08-03T10:56:50.306 DEBUG:teuthology.orchestra.run.smithi101:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2021-08-03T10:56:50.369 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 187606d9-4e3e-4c93-892c-4b83377f9774 0 2021-08-03T10:56:50.963 INFO:teuthology.orchestra.run.smithi101.stdout:0 2021-08-03T10:56:51.128 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8 1 2021-08-03T10:56:51.650 INFO:teuthology.orchestra.run.smithi101.stdout:1 2021-08-03T10:56:51.662 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89 2 2021-08-03T10:56:52.154 INFO:teuthology.orchestra.run.smithi101.stdout:2 2021-08-03T10:56:52.167 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63 3 2021-08-03T10:56:52.653 INFO:teuthology.orchestra.run.smithi101.stdout:3 2021-08-03T10:56:52.665 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new 8ff977e0-4f2d-477a-8734-debaedb2b69d 4 2021-08-03T10:56:53.287 INFO:teuthology.orchestra.run.smithi101.stdout:4 2021-08-03T10:56:53.299 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new ad508f30-aab4-4f0f-9638-aa431d16fc77 5 2021-08-03T10:56:53.739 INFO:teuthology.orchestra.run.smithi101.stdout:5 2021-08-03T10:56:53.752 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new ed3b0daf-a693-49bc-863a-e29a8c75f39f 6 2021-08-03T10:56:54.946 INFO:teuthology.orchestra.run.smithi101.stdout:6 2021-08-03T10:56:54.959 DEBUG:teuthology.orchestra.run.smithi101:> sudo ceph --cluster ceph osd new d5b5f71b-aff9-437d-8392-dc26641bc1b7 7 2021-08-03T10:56:56.000 INFO:teuthology.orchestra.run.smithi101.stdout:7 2021-08-03T10:56:56.012 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.012 INFO:tasks.ceph.osd.0:Restarting daemon 2021-08-03T10:56:56.013 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2021-08-03T10:56:56.015 INFO:tasks.ceph.osd.0:Started 2021-08-03T10:56:56.015 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.016 INFO:tasks.ceph.osd.1:Restarting daemon 2021-08-03T10:56:56.016 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2021-08-03T10:56:56.018 INFO:tasks.ceph.osd.1:Started 2021-08-03T10:56:56.019 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.019 INFO:tasks.ceph.osd.2:Restarting daemon 2021-08-03T10:56:56.019 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2021-08-03T10:56:56.022 INFO:tasks.ceph.osd.2:Started 2021-08-03T10:56:56.022 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.022 INFO:tasks.ceph.osd.3:Restarting daemon 2021-08-03T10:56:56.023 DEBUG:teuthology.orchestra.run.smithi003:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2021-08-03T10:56:56.025 INFO:tasks.ceph.osd.3:Started 2021-08-03T10:56:56.025 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.026 INFO:tasks.ceph.osd.4:Restarting daemon 2021-08-03T10:56:56.026 DEBUG:teuthology.orchestra.run.smithi101:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2021-08-03T10:56:56.028 INFO:tasks.ceph.osd.4:Started 2021-08-03T10:56:56.029 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.029 INFO:tasks.ceph.osd.5:Restarting daemon 2021-08-03T10:56:56.029 DEBUG:teuthology.orchestra.run.smithi101:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2021-08-03T10:56:56.031 INFO:tasks.ceph.osd.5:Started 2021-08-03T10:56:56.032 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.032 INFO:tasks.ceph.osd.6:Restarting daemon 2021-08-03T10:56:56.033 DEBUG:teuthology.orchestra.run.smithi101:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2021-08-03T10:56:56.035 INFO:tasks.ceph.osd.6:Started 2021-08-03T10:56:56.035 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2021-08-03T10:56:56.035 INFO:tasks.ceph.osd.7:Restarting daemon 2021-08-03T10:56:56.036 DEBUG:teuthology.orchestra.run.smithi101:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2021-08-03T10:56:56.038 INFO:tasks.ceph.osd.7:Started 2021-08-03T10:56:56.038 INFO:tasks.ceph:Waiting for OSDs to come up 2021-08-03T10:56:56.845 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:56:58.241 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:56:58.241 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:56:55.645396+0000","last_up_change":"0.000000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:56:58.263 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-08-03T10:57:05.069 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:57:05.417 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:09.324 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.489 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:09.396 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.505 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:09.412 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.510 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:09.412 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.565 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:09.472 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.578 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:09.481 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.628 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:09.525 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.689 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:09.587 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:05.840 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:57:05.840 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:56:55.645396+0000","last_up_change":"0.000000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:57:05.855 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-08-03T10:57:06.061 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T10:57:06.048+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:06.129 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:10.034 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.179 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T10:57:06.165+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:06.179 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T10:57:06.166+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:06.187 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T10:57:06.183+0000 c4bf700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2021-08-03T10:57:06.197 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:10.110 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.203 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:10.109 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.264 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:10.176 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.271 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T10:57:06.254+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:06.303 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:10.213 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.367 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:10.276 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.384 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:10.300 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.448 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:10.363 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.468 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:10.375 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.600 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:10.502 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.601 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:10.507 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.688 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:10.586 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.761 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T10:57:06.747+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:06.836 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:10.744 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.845 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T10:57:06.825+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:06.973 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:10.880 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.974 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:10.876 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:06.982 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T10:57:06.966+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:07.048 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T10:57:07.034+0000 4045280 -1 Falling back to public interface 2021-08-03T10:57:07.053 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:10.951 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.197 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:11.104 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.210 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:11.116 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.256 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:11.169 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.336 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:11.243 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.340 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:11.242 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.394 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:11.292 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.436 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:11.345 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.503 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:11.418 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.508 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:11.415 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.582 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:11.488 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.632 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:11.544 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.641 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:11.547 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.648 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:11.551 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.694 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:11.591 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.700 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:11.607 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.752 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:11.650 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.805 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:11.714 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.808 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:11.715 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.859 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:11.766 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.873 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:11.789 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.943 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:11.849 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.944 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:11.847 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.989 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:11.902 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:07.997 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:11.904 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.049 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:11.947 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.107 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:12.017 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.156 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:12.063 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.204 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:12.120 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.242 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:12.144 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.245 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:12.151 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.267 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:12.173 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.291 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:12.198 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.294 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:12.207 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.324 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:12.222 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.376 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:12.285 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.423 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:12.330 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.472 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:12.388 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.514 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:12.416 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.538 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:12.444 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.558 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:12.465 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.566 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:12.479 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.592 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:12.489 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.655 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:12.564 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.690 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:12.597 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.743 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:12.659 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.780 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:12.682 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.807 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:12.714 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.829 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:12.736 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.840 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:12.753 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.859 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:12.757 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:08.921 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:12.831 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.012 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:12.927 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.045 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:12.947 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.058 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:12.965 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.075 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:12.981 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.112 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:13.025 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.121 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:13.028 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.189 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:13.098 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.197 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:13.104 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.234 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:13.131 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.262 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:13.169 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.286 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:13.202 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.299 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:13.196 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.342 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:13.248 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.383 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:13.295 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.446 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:13.348 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.456 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:13.365 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.511 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:13.413 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.554 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:13.470 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.651 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:13.563 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.722 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:13.632 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.726 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:13.632 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.791 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:13.697 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:09.826 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:13.741 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:10.023 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:13.935 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:10.089 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:14.001 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:10.092 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:14.001 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:10.168 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:14.077 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:10.244 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:14.159 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:10.310 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:14.225 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:12.662 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:57:13.484 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:57:13.484 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:56:55.645396+0000","last_up_change":"0.000000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:57:13.502 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-08-03T10:57:16.220 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:20.127 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:16.224 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:20.122 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:16.242 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:20.148 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:16.492 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:20.394 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:17.325 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:21.231 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:17.698 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:21.611 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:17.852 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:21.761 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:17.932 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:21.848 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:20.309 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:57:21.289 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:57:21.290 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:56:55.645396+0000","last_up_change":"0.000000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:57:21.306 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-08-03T10:57:24.597 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:28.504 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:24.601 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:28.508 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:24.726 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:28.633 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:24.730 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:28.637 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:24.776 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:28.674 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:24.783 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:28.681 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:25.415 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:29.317 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:25.422 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:29.324 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:26.325 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:30.231 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:26.329 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:30.236 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:26.842 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:30.755 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:26.846 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:30.759 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:27.002 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:30.911 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:27.006 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:30.916 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:27.170 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:31.086 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:27.175 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:31.091 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:28.113 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:57:28.943 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:57:28.944 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:56:55.645396+0000","last_up_change":"0.000000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:57:28.961 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-08-03T10:57:29.159 INFO:tasks.ceph.osd.5.smithi101.stderr:==00:00:00:33.066 34602== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:29.321 INFO:tasks.ceph.osd.4.smithi101.stderr:==00:00:00:33.228 34601== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:29.348 INFO:tasks.ceph.osd.7.smithi101.stderr:==00:00:00:33.246 34604== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:29.857 INFO:tasks.ceph.osd.6.smithi101.stderr:==00:00:00:33.759 34603== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:31.201 INFO:tasks.ceph.osd.3.smithi003.stderr:==00:00:00:35.107 34660== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:31.777 INFO:tasks.ceph.osd.1.smithi003.stderr:==00:00:00:35.689 34658== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:31.978 INFO:tasks.ceph.osd.2.smithi003.stderr:==00:00:00:35.887 34659== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:32.020 INFO:tasks.ceph.osd.0.smithi003.stderr:==00:00:00:35.936 34657== Warning: unimplemented fcntl command: 1038 2021-08-03T10:57:35.769 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:57:36.628 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:57:36.628 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":10,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:56:55.645396+0000","last_up_change":"0.000000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:57:36.643 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-08-03T10:57:37.176 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T10:57:37.169+0000 4045280 -1 osd.5 0 log_to_monitors {default=true} 2021-08-03T10:57:37.340 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T10:57:37.334+0000 4045280 -1 osd.4 0 log_to_monitors {default=true} 2021-08-03T10:57:37.378 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T10:57:37.372+0000 4045280 -1 osd.7 0 log_to_monitors {default=true} 2021-08-03T10:57:37.999 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T10:57:37.985+0000 4045280 -1 osd.6 0 log_to_monitors {default=true} 2021-08-03T10:57:39.703 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T10:57:39.696+0000 4045280 -1 osd.3 0 log_to_monitors {default=true} 2021-08-03T10:57:40.363 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T10:57:40.262+0000 4045280 -1 osd.1 0 log_to_monitors {default=true} 2021-08-03T10:57:40.480 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T10:57:40.474+0000 4045280 -1 osd.2 0 log_to_monitors {default=true} 2021-08-03T10:57:40.524 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T10:57:40.516+0000 4045280 -1 osd.0 0 log_to_monitors {default=true} 2021-08-03T10:57:41.453 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T10:57:41.448+0000 e4c3700 -1 osd.4 0 waiting for initial osdmap 2021-08-03T10:57:41.527 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T10:57:41.517+0000 100c6700 -1 osd.7 0 waiting for initial osdmap 2021-08-03T10:57:41.543 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T10:57:41.535+0000 e4c3700 -1 osd.6 0 waiting for initial osdmap 2021-08-03T10:57:41.547 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T10:57:41.540+0000 100c6700 -1 osd.5 0 waiting for initial osdmap 2021-08-03T10:57:42.021 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T10:57:42.006+0000 15751700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:57:42.041 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T10:57:42.025+0000 15751700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:57:42.046 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T10:57:42.031+0000 14f50700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:57:42.062 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T10:57:42.040+0000 14f50700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:57:43.450 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:57:43.681 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T10:57:43.672+0000 e4c3700 -1 osd.3 0 waiting for initial osdmap 2021-08-03T10:57:43.722 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T10:57:43.713+0000 100c6700 -1 osd.1 0 waiting for initial osdmap 2021-08-03T10:57:44.047 INFO:tasks.ceph.mon.a.smithi003.stderr:==00:00:01:18.459 34328== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:44.196 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T10:57:44.180+0000 13f4e700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:57:44.213 INFO:tasks.ceph.mon.a.smithi003.stderr:==00:00:01:18.625 34328== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:44.243 INFO:tasks.ceph.mon.b.smithi101.stderr:==00:00:01:18.638 33958== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:44.348 INFO:tasks.ceph.mon.c.smithi003.stderr:==00:00:01:18.759 34334== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:44.448 INFO:tasks.ceph.mon.b.smithi101.stderr:==00:00:01:18.843 33958== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:44.464 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T10:57:44.444+0000 13f4e700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:57:44.602 INFO:tasks.ceph.mon.c.smithi003.stderr:==00:00:01:19.014 34334== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:44.830 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:57:44.831 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":14,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:57:42.974142+0000","last_up_change":"2021-08-03T10:57:42.974142+0000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":34601},{"type":"v1","addr":"172.21.15.101:6813","nonce":34601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6815","nonce":34601},{"type":"v1","addr":"172.21.15.101:6817","nonce":34601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6824","nonce":34601},{"type":"v1","addr":"172.21.15.101:6825","nonce":34601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":34601},{"type":"v1","addr":"172.21.15.101:6821","nonce":34601}]},"public_addr":"172.21.15.101:6813/34601","cluster_addr":"172.21.15.101:6817/34601","heartbeat_back_addr":"172.21.15.101:6825/34601","heartbeat_front_addr":"172.21.15.101:6821/34601","state":["exists","up"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":34602},{"type":"v1","addr":"172.21.15.101:6803","nonce":34602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":34602},{"type":"v1","addr":"172.21.15.101:6805","nonce":34602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":34602},{"type":"v1","addr":"172.21.15.101:6809","nonce":34602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":34602},{"type":"v1","addr":"172.21.15.101:6807","nonce":34602}]},"public_addr":"172.21.15.101:6803/34602","cluster_addr":"172.21.15.101:6805/34602","heartbeat_back_addr":"172.21.15.101:6809/34602","heartbeat_front_addr":"172.21.15.101:6807/34602","state":["exists","up"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":34603},{"type":"v1","addr":"172.21.15.101:6811","nonce":34603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":34603},{"type":"v1","addr":"172.21.15.101:6816","nonce":34603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":34603},{"type":"v1","addr":"172.21.15.101:6823","nonce":34603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":34603},{"type":"v1","addr":"172.21.15.101:6820","nonce":34603}]},"public_addr":"172.21.15.101:6811/34603","cluster_addr":"172.21.15.101:6816/34603","heartbeat_back_addr":"172.21.15.101:6823/34603","heartbeat_front_addr":"172.21.15.101:6820/34603","state":["exists","up"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":34604},{"type":"v1","addr":"172.21.15.101:6827","nonce":34604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6828","nonce":34604},{"type":"v1","addr":"172.21.15.101:6829","nonce":34604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6832","nonce":34604},{"type":"v1","addr":"172.21.15.101:6833","nonce":34604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":34604},{"type":"v1","addr":"172.21.15.101:6831","nonce":34604}]},"public_addr":"172.21.15.101:6827/34604","cluster_addr":"172.21.15.101:6829/34604","heartbeat_back_addr":"172.21.15.101:6833/34604","heartbeat_front_addr":"172.21.15.101:6831/34604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:57:44.842 DEBUG:teuthology.misc:4 of 8 OSDs are up 2021-08-03T10:57:44.863 INFO:tasks.ceph.mon.a.smithi003.stderr:==00:00:01:19.275 34328== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:44.947 INFO:tasks.ceph.mon.b.smithi101.stderr:==00:00:01:19.341 33958== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:45.136 INFO:tasks.ceph.mon.c.smithi003.stderr:==00:00:01:19.548 34334== Warning: unimplemented fcntl command: 1036 2021-08-03T10:57:51.649 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:57:59.982 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T10:57:59.973+0000 100c6700 -1 osd.2 0 waiting for initial osdmap 2021-08-03T10:58:00.134 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T10:58:00.130+0000 100c6700 -1 osd.0 0 waiting for initial osdmap 2021-08-03T10:58:01.315 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T10:58:01.299+0000 1374d700 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:58:01.810 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T10:58:01.794+0000 1374d700 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-03T10:58:03.378 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:58:03.378 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":15,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:57:44.573455+0000","last_up_change":"2021-08-03T10:57:42.974142+0000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":34601},{"type":"v1","addr":"172.21.15.101:6813","nonce":34601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6815","nonce":34601},{"type":"v1","addr":"172.21.15.101:6817","nonce":34601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6824","nonce":34601},{"type":"v1","addr":"172.21.15.101:6825","nonce":34601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":34601},{"type":"v1","addr":"172.21.15.101:6821","nonce":34601}]},"public_addr":"172.21.15.101:6813/34601","cluster_addr":"172.21.15.101:6817/34601","heartbeat_back_addr":"172.21.15.101:6825/34601","heartbeat_front_addr":"172.21.15.101:6821/34601","state":["exists","up"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":34602},{"type":"v1","addr":"172.21.15.101:6803","nonce":34602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":34602},{"type":"v1","addr":"172.21.15.101:6805","nonce":34602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":34602},{"type":"v1","addr":"172.21.15.101:6809","nonce":34602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":34602},{"type":"v1","addr":"172.21.15.101:6807","nonce":34602}]},"public_addr":"172.21.15.101:6803/34602","cluster_addr":"172.21.15.101:6805/34602","heartbeat_back_addr":"172.21.15.101:6809/34602","heartbeat_front_addr":"172.21.15.101:6807/34602","state":["exists","up"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":34603},{"type":"v1","addr":"172.21.15.101:6811","nonce":34603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":34603},{"type":"v1","addr":"172.21.15.101:6816","nonce":34603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":34603},{"type":"v1","addr":"172.21.15.101:6823","nonce":34603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":34603},{"type":"v1","addr":"172.21.15.101:6820","nonce":34603}]},"public_addr":"172.21.15.101:6811/34603","cluster_addr":"172.21.15.101:6816/34603","heartbeat_back_addr":"172.21.15.101:6823/34603","heartbeat_front_addr":"172.21.15.101:6820/34603","state":["exists","up"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":34604},{"type":"v1","addr":"172.21.15.101:6827","nonce":34604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6828","nonce":34604},{"type":"v1","addr":"172.21.15.101:6829","nonce":34604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6832","nonce":34604},{"type":"v1","addr":"172.21.15.101:6833","nonce":34604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":34604},{"type":"v1","addr":"172.21.15.101:6831","nonce":34604}]},"public_addr":"172.21.15.101:6827/34604","cluster_addr":"172.21.15.101:6829/34604","heartbeat_back_addr":"172.21.15.101:6833/34604","heartbeat_front_addr":"172.21.15.101:6831/34604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.471353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.411790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:58:03.395 DEBUG:teuthology.misc:4 of 8 OSDs are up 2021-08-03T10:58:10.203 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:58:18.234 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:58:18.223+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 3 slow ops, oldest is log(1 entries from seq 96 at 2021-08-03T10:57:45.981104+0000) 2021-08-03T10:58:24.030 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:58:24.028+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 5 slow ops, oldest is log(1 entries from seq 96 at 2021-08-03T10:57:45.981104+0000) 2021-08-03T10:58:30.584 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:58:30.465+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2 slow ops, oldest is log(1 entries from seq 22 at 2021-08-03T10:57:56.217965+0000) 2021-08-03T10:58:35.467 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:58:35.340+0000 11e3d700 -1 mon.c@2(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_boot(osd.0 booted 0 features 4540138303579357183 v15) 2021-08-03T10:58:40.608 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:58:40.530+0000 11e3d700 -1 mon.c@2(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_boot(osd.0 booted 0 features 4540138303579357183 v15) 2021-08-03T10:58:41.165 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:58:40.682+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 1 slow ops, oldest is mon_command({"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} v 0) 2021-08-03T10:58:42.366 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:58:42.367 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":17,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:58:10.564030+0000","last_up_change":"2021-08-03T10:58:10.564030+0000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-08-03T10:57:52.477544+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":34658},{"type":"v1","addr":"172.21.15.3:6809","nonce":34658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":34658},{"type":"v1","addr":"172.21.15.3:6811","nonce":34658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":34658},{"type":"v1","addr":"172.21.15.3:6815","nonce":34658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":34658},{"type":"v1","addr":"172.21.15.3:6813","nonce":34658}]},"public_addr":"172.21.15.3:6809/34658","cluster_addr":"172.21.15.3:6811/34658","heartbeat_back_addr":"172.21.15.3:6815/34658","heartbeat_front_addr":"172.21.15.3:6813/34658","state":["exists","up"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":34659},{"type":"v1","addr":"172.21.15.3:6817","nonce":34659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":34659},{"type":"v1","addr":"172.21.15.3:6819","nonce":34659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":34659},{"type":"v1","addr":"172.21.15.3:6823","nonce":34659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":34659},{"type":"v1","addr":"172.21.15.3:6821","nonce":34659}]},"public_addr":"172.21.15.3:6817/34659","cluster_addr":"172.21.15.3:6819/34659","heartbeat_back_addr":"172.21.15.3:6823/34659","heartbeat_front_addr":"172.21.15.3:6821/34659","state":["exists","up"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":34660},{"type":"v1","addr":"172.21.15.3:6801","nonce":34660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":34660},{"type":"v1","addr":"172.21.15.3:6803","nonce":34660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":34660},{"type":"v1","addr":"172.21.15.3:6807","nonce":34660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":34660},{"type":"v1","addr":"172.21.15.3:6805","nonce":34660}]},"public_addr":"172.21.15.3:6801/34660","cluster_addr":"172.21.15.3:6803/34660","heartbeat_back_addr":"172.21.15.3:6807/34660","heartbeat_front_addr":"172.21.15.3:6805/34660","state":["exists","up"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":34601},{"type":"v1","addr":"172.21.15.101:6813","nonce":34601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6815","nonce":34601},{"type":"v1","addr":"172.21.15.101:6817","nonce":34601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6824","nonce":34601},{"type":"v1","addr":"172.21.15.101:6825","nonce":34601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":34601},{"type":"v1","addr":"172.21.15.101:6821","nonce":34601}]},"public_addr":"172.21.15.101:6813/34601","cluster_addr":"172.21.15.101:6817/34601","heartbeat_back_addr":"172.21.15.101:6825/34601","heartbeat_front_addr":"172.21.15.101:6821/34601","state":["exists","up"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":34602},{"type":"v1","addr":"172.21.15.101:6803","nonce":34602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":34602},{"type":"v1","addr":"172.21.15.101:6805","nonce":34602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":34602},{"type":"v1","addr":"172.21.15.101:6809","nonce":34602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":34602},{"type":"v1","addr":"172.21.15.101:6807","nonce":34602}]},"public_addr":"172.21.15.101:6803/34602","cluster_addr":"172.21.15.101:6805/34602","heartbeat_back_addr":"172.21.15.101:6809/34602","heartbeat_front_addr":"172.21.15.101:6807/34602","state":["exists","up"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":34603},{"type":"v1","addr":"172.21.15.101:6811","nonce":34603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":34603},{"type":"v1","addr":"172.21.15.101:6816","nonce":34603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":34603},{"type":"v1","addr":"172.21.15.101:6823","nonce":34603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":34603},{"type":"v1","addr":"172.21.15.101:6820","nonce":34603}]},"public_addr":"172.21.15.101:6811/34603","cluster_addr":"172.21.15.101:6816/34603","heartbeat_back_addr":"172.21.15.101:6823/34603","heartbeat_front_addr":"172.21.15.101:6820/34603","state":["exists","up"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":34604},{"type":"v1","addr":"172.21.15.101:6827","nonce":34604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6828","nonce":34604},{"type":"v1","addr":"172.21.15.101:6829","nonce":34604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6832","nonce":34604},{"type":"v1","addr":"172.21.15.101:6833","nonce":34604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":34604},{"type":"v1","addr":"172.21.15.101:6831","nonce":34604}]},"public_addr":"172.21.15.101:6827/34604","cluster_addr":"172.21.15.101:6829/34604","heartbeat_back_addr":"172.21.15.101:6833/34604","heartbeat_front_addr":"172.21.15.101:6831/34604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.471353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.411790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:40.160081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.608946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:58:42.380 DEBUG:teuthology.misc:7 of 8 OSDs are up 2021-08-03T10:58:46.189 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:58:46.185+0000 11e3d700 -1 mon.c@2(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_boot(osd.0 booted 0 features 4540138303579357183 v15) 2021-08-03T10:58:46.583 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:58:46.553+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 8 slow ops, oldest is mon_command({"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} v 0) 2021-08-03T10:58:49.186 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-03T10:58:50.935 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:58:50.856+0000 11e3d700 -1 mon.a@0(peon) e1 get_health_metrics reporting 1 slow ops, oldest is log(1 entries from seq 98 at 2021-08-03T10:58:20.826317+0000) 2021-08-03T10:58:51.567 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:58:51.417+0000 11e3d700 -1 mon.c@2(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_boot(osd.0 booted 0 features 4540138303579357183 v15) 2021-08-03T10:58:52.216 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:58:51.985+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 9 slow ops, oldest is mon_command({"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} v 0) 2021-08-03T10:58:56.132 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:58:56.067+0000 11e3d700 -1 mon.a@0(peon) e1 get_health_metrics reporting 3 slow ops, oldest is log(1 entries from seq 98 at 2021-08-03T10:58:20.826317+0000) 2021-08-03T10:58:57.827 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:58:57.285+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 10 slow ops, oldest is log(1 entries from seq 29 at 2021-08-03T10:58:10.220176+0000) 2021-08-03T10:58:59.805 INFO:teuthology.misc.health.smithi003.stdout: 2021-08-03T10:58:59.806 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":18,"fsid":"03d513f3-0a93-4a0d-ad7b-451d7864f99d","created":"2021-08-03T10:56:47.586155+0000","modified":"2021-08-03T10:58:42.696205+0000","last_up_change":"2021-08-03T10:58:42.696205+0000","last_in_change":"2021-08-03T10:56:55.645396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-08-03T10:57:52.477544+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"187606d9-4e3e-4c93-892c-4b83377f9774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":34657},{"type":"v1","addr":"172.21.15.3:6825","nonce":34657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":34657},{"type":"v1","addr":"172.21.15.3:6827","nonce":34657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":34657},{"type":"v1","addr":"172.21.15.3:6831","nonce":34657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":34657},{"type":"v1","addr":"172.21.15.3:6829","nonce":34657}]},"public_addr":"172.21.15.3:6825/34657","cluster_addr":"172.21.15.3:6827/34657","heartbeat_back_addr":"172.21.15.3:6831/34657","heartbeat_front_addr":"172.21.15.3:6829/34657","state":["exists","up"]},{"osd":1,"uuid":"1a5f3f3b-b7e4-4d33-bc0a-2f4e34efdaa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":34658},{"type":"v1","addr":"172.21.15.3:6809","nonce":34658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":34658},{"type":"v1","addr":"172.21.15.3:6811","nonce":34658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":34658},{"type":"v1","addr":"172.21.15.3:6815","nonce":34658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":34658},{"type":"v1","addr":"172.21.15.3:6813","nonce":34658}]},"public_addr":"172.21.15.3:6809/34658","cluster_addr":"172.21.15.3:6811/34658","heartbeat_back_addr":"172.21.15.3:6815/34658","heartbeat_front_addr":"172.21.15.3:6813/34658","state":["exists","up"]},{"osd":2,"uuid":"e7227ee1-f4ea-4f2d-bdb1-f11580ebfe89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":34659},{"type":"v1","addr":"172.21.15.3:6817","nonce":34659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":34659},{"type":"v1","addr":"172.21.15.3:6819","nonce":34659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":34659},{"type":"v1","addr":"172.21.15.3:6823","nonce":34659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":34659},{"type":"v1","addr":"172.21.15.3:6821","nonce":34659}]},"public_addr":"172.21.15.3:6817/34659","cluster_addr":"172.21.15.3:6819/34659","heartbeat_back_addr":"172.21.15.3:6823/34659","heartbeat_front_addr":"172.21.15.3:6821/34659","state":["exists","up"]},{"osd":3,"uuid":"6bd2f93c-7c49-4bf9-9cd3-b28510e1cf63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":34660},{"type":"v1","addr":"172.21.15.3:6801","nonce":34660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":34660},{"type":"v1","addr":"172.21.15.3:6803","nonce":34660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":34660},{"type":"v1","addr":"172.21.15.3:6807","nonce":34660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":34660},{"type":"v1","addr":"172.21.15.3:6805","nonce":34660}]},"public_addr":"172.21.15.3:6801/34660","cluster_addr":"172.21.15.3:6803/34660","heartbeat_back_addr":"172.21.15.3:6807/34660","heartbeat_front_addr":"172.21.15.3:6805/34660","state":["exists","up"]},{"osd":4,"uuid":"8ff977e0-4f2d-477a-8734-debaedb2b69d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6812","nonce":34601},{"type":"v1","addr":"172.21.15.101:6813","nonce":34601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6815","nonce":34601},{"type":"v1","addr":"172.21.15.101:6817","nonce":34601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6824","nonce":34601},{"type":"v1","addr":"172.21.15.101:6825","nonce":34601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6819","nonce":34601},{"type":"v1","addr":"172.21.15.101:6821","nonce":34601}]},"public_addr":"172.21.15.101:6813/34601","cluster_addr":"172.21.15.101:6817/34601","heartbeat_back_addr":"172.21.15.101:6825/34601","heartbeat_front_addr":"172.21.15.101:6821/34601","state":["exists","up"]},{"osd":5,"uuid":"ad508f30-aab4-4f0f-9638-aa431d16fc77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6802","nonce":34602},{"type":"v1","addr":"172.21.15.101:6803","nonce":34602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6804","nonce":34602},{"type":"v1","addr":"172.21.15.101:6805","nonce":34602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6808","nonce":34602},{"type":"v1","addr":"172.21.15.101:6809","nonce":34602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6806","nonce":34602},{"type":"v1","addr":"172.21.15.101:6807","nonce":34602}]},"public_addr":"172.21.15.101:6803/34602","cluster_addr":"172.21.15.101:6805/34602","heartbeat_back_addr":"172.21.15.101:6809/34602","heartbeat_front_addr":"172.21.15.101:6807/34602","state":["exists","up"]},{"osd":6,"uuid":"ed3b0daf-a693-49bc-863a-e29a8c75f39f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6810","nonce":34603},{"type":"v1","addr":"172.21.15.101:6811","nonce":34603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6814","nonce":34603},{"type":"v1","addr":"172.21.15.101:6816","nonce":34603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6822","nonce":34603},{"type":"v1","addr":"172.21.15.101:6823","nonce":34603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6818","nonce":34603},{"type":"v1","addr":"172.21.15.101:6820","nonce":34603}]},"public_addr":"172.21.15.101:6811/34603","cluster_addr":"172.21.15.101:6816/34603","heartbeat_back_addr":"172.21.15.101:6823/34603","heartbeat_front_addr":"172.21.15.101:6820/34603","state":["exists","up"]},{"osd":7,"uuid":"d5b5f71b-aff9-437d-8392-dc26641bc1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6826","nonce":34604},{"type":"v1","addr":"172.21.15.101:6827","nonce":34604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6828","nonce":34604},{"type":"v1","addr":"172.21.15.101:6829","nonce":34604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6832","nonce":34604},{"type":"v1","addr":"172.21.15.101:6833","nonce":34604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.101:6830","nonce":34604},{"type":"v1","addr":"172.21.15.101:6831","nonce":34604}]},"public_addr":"172.21.15.101:6827/34604","cluster_addr":"172.21.15.101:6829/34604","heartbeat_back_addr":"172.21.15.101:6833/34604","heartbeat_front_addr":"172.21.15.101:6831/34604","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:42.778319+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.471353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.411790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:40.160081+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-03T10:57:39.608946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-03T10:58:59.822 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-08-03T10:58:59.823 INFO:tasks.ceph:Creating RBD pool 2021-08-03T10:58:59.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool create rbd 8 2021-08-03T10:59:01.413 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:59:01.221+0000 11e3d700 -1 mon.a@0(peon) e1 get_health_metrics reporting 3 slow ops, oldest is log(1 entries from seq 98 at 2021-08-03T10:58:20.826317+0000) 2021-08-03T10:59:03.082 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:02.920+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 13 slow ops, oldest is log(1 entries from seq 29 at 2021-08-03T10:58:10.220176+0000) 2021-08-03T10:59:09.754 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:59:09.657+0000 11e3d700 -1 mon.a@0(peon) e1 get_health_metrics reporting 3 slow ops, oldest is log(1 entries from seq 98 at 2021-08-03T10:58:20.826317+0000) 2021-08-03T10:59:13.226 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:13.217+0000 14642700 -1 mon.b@1(peon).paxos(paxos updating c 1..89) lease_expire from mon.2 v2:172.21.15.3:3301/0 is 3.106083393s seconds in the past; mons are probably laggy (or possibly clocks are too skewed) 2021-08-03T10:59:13.271 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:13.229+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 20 slow ops, oldest is log(1 entries from seq 29 at 2021-08-03T10:58:10.220176+0000) 2021-08-03T10:59:19.663 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:19.504+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 7 slow ops, oldest is log(1 entries from seq 43 at 2021-08-03T10:58:38.224714+0000) 2021-08-03T10:59:25.077 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:25.073+0000 11e3d700 -1 mon.b@1(probing) e1 get_health_metrics reporting 2 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T10:59:30.924 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:30.784+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 6 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T10:59:36.816 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:59:36.773+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T10:59:36.904 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:59:36.477+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T10:59:38.945 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:38.708+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 15 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T10:59:41.889 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:59:41.871+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T10:59:42.329 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:59:42.311+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 12 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T10:59:45.899 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:45.856+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 28 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T10:59:48.177 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:59:48.079+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 14 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T10:59:50.018 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:59:50.006+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T10:59:51.001 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:50.971+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 37 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T10:59:53.306 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:59:53.217+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 15 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T10:59:57.347 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T10:59:57.294+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 13 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T10:59:58.205 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T10:59:58.160+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 49 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T10:59:58.426 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T10:59:58.376+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 15 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:02.817 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:02.741+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 18 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:03.446 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:03.232+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 56 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:03.475 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:03.456+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 19 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:08.538 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:08.504+0000 11e3d700 -1 mon.c@2(leader) e1 get_health_metrics reporting 21 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:08.590 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:08.248+0000 11e3d700 -1 mon.b@1(peon) e1 get_health_metrics reporting 61 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:10.045 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:09.982+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 26 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:13.773 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:13.755+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 30 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:14.107 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:13.695+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 62 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:15.041 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:15.020+0000 11e3d700 -1 mon.a@0(leader) e1 get_health_metrics reporting 28 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:20.795 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:20.765+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 62 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:21.649 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:21.534+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 31 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:22.786 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:22.678+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 43 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:27.071 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:27.069+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 62 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:28.103 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:28.101+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 46 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:28.414 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:28.275+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 49 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:32.996 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:32.328+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 62 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:35.079 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:35.042+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 58 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:35.190 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:35.168+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 54 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:38.368 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:38.225+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 73 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:40.732 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:40.635+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 62 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:41.156 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:41.094+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 61 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:45.600 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:45.585+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 87 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:46.046 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:46.042+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 67 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:48.276 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:48.272+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 64 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:52.880 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:52.877+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 68 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:00:53.585 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:53.582+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 88 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:54.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:00:54.196+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 74 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:00:58.611 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:00:58.608+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 89 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:00:58.846 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:00:58.826+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 72 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:00.630 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:00.544+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 83 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:06.024 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:05.870+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 74 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:06.288 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:06.272+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 90 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:08.415 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:08.106+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 90 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:11.137 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:11.134+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 96 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:11.335 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:11.333+0000 11e3d700 -1 mon.b@1(leader) e1 get_health_metrics reporting 89 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:13.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:13.163+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 91 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:14.897 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T11:01:14.896+0000 7f57d4fe3700 0 -- 172.21.15.3:0/3813029560 >> [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] conn(0x7f57b0009b70 msgr2=0x7f57b4015b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-03T11:01:16.418 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:16.343+0000 11e3d700 -1 mon.b@1(leader) e1 get_health_metrics reporting 92 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:17.036 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:16.984+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 110 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:18.391 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:18.388+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 92 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:21.819 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:21.576+0000 11e3d700 -1 mon.b@1(probing) e1 get_health_metrics reporting 92 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:22.041 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:22.038+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 129 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:23.461 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:23.391+0000 11e3d700 -1 mon.a@0(leader) e1 get_health_metrics reporting 95 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:27.080 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:27.074+0000 11e3d700 -1 mon.b@1(probing) e1 get_health_metrics reporting 101 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:27.586 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:27.507+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 130 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:30.985 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:30.825+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 99 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:34.686 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:34.631+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 139 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:35.786 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:35.778+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 101 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:36.820 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T11:01:36.819+0000 7f57d5fe5700 0 -- 172.21.15.3:0/3813029560 >> [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] conn(0x7f57b0009f50 msgr2=0x7f57b400b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-03T11:01:37.939 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:37.579+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 100 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:39.819 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:39.758+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 139 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:42.195 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:42.124+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 109 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:43.425 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:43.162+0000 11e3d700 -1 mon.a@0(leader) e1 get_health_metrics reporting 105 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:45.226 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:45.060+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 146 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:48.214 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:48.195+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 105 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:51.205 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:51.178+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 157 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:51.375 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:51.372+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 123 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:53.624 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:53.359+0000 11e3d700 -1 mon.a@0(leader) e1 get_health_metrics reporting 108 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:01:56.592 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:01:56.524+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 161 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:01:57.587 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:01:57.584+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 134 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:01:58.748 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:01:58.712+0000 11e3d700 -1 mon.a@0(leader) e1 get_health_metrics reporting 110 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:01.539 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:01.537+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 165 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:03.753 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:03.720+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 111 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:05.442 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:05.437+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 141 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:07.426 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:07.403+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 168 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:11.501 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:11.417+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 142 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:12.755 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:12.753+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 114 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:13.173 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:12.789+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 176 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:16.835 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:16.740+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 142 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:18.300 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:18.253+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 118 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:19.081 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:18.970+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 202 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:24.233 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:23.904+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 122 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:24.432 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:24.407+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 203 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:25.607 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:24.803+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 143 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:29.101 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:29.052+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 125 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:29.921 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:29.850+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 228 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:31.435 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:30.774+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 144 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:35.068 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:34.752+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 131 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:36.204 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:36.069+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 232 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:38.707 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:38.331+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 156 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:40.129 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:39.889+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 132 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:41.746 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:41.707+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 233 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:44.645 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:44.615+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 163 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:45.022 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:44.911+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 139 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:47.279 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:47.261+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 240 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:49.802 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:49.623+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 164 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:50.204 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:50.184+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 147 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:52.552 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:52.402+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 251 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:02:54.729 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:02:54.630+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 164 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:02:56.607 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:02:56.411+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 147 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:02:58.047 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:02:58.028+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 271 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:01.303 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:01.202+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 164 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:02.802 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:02.546+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 147 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:03.914 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:03.887+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 280 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:06.703 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:06.394+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 164 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:09.644 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:09.530+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 280 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:10.651 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:10.252+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 149 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:11.582 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:11.577+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 164 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:14.736 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:14.601+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 283 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:16.079 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:16.076+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 151 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:17.178 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:16.931+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 166 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:19.959 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:19.930+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 285 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:22.812 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:22.715+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 152 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:22.997 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:22.697+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 166 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:26.963 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:26.786+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 312 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:27.859 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:27.793+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 166 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:28.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:27.851+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 152 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:32.820 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:32.818+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 167 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:33.053 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:33.025+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 335 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:33.257 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:33.153+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 153 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:38.717 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:38.683+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 155 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:40.758 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:40.542+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 169 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:41.243 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:40.853+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 344 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:43.883 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:43.713+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 155 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:46.850 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:46.846+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 345 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:47.611 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:47.570+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 173 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:49.921 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:49.497+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 158 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:52.736 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:52.612+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 175 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:03:53.459 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:03:53.368+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 352 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:03:54.716 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:54.498+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 160 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:03:59.282 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:03:58.631+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 188 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:00.082 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:03:59.807+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 164 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:00.928 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:00.679+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 353 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:05.035 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:04.987+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 167 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:06.356 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:05.617+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 195 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:08.981 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:08.742+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 359 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:10.896 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:10.838+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 167 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:13.659 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:13.590+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 199 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:16.101 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:16.038+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:16.363 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:16.359+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 174 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:20.291 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:20.084+0000 11e3d700 -1 mon.b@1(leader) e1 get_health_metrics reporting 195 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:21.394 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:21.391+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 188 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:21.687 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:21.592+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 364 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:25.413 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:25.411+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 207 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:26.737 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:26.717+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 366 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:26.819 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:26.768+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 191 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:31.272 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:31.159+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 208 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:31.998 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:31.789+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 193 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:32.141 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:32.135+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 368 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:36.439 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:36.289+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 208 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:37.339 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:37.212+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 210 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:37.589 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:37.568+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 372 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:43.222 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:43.203+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 210 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:45.388 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:45.172+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 374 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:45.746 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:45.557+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 222 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:51.443 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:50.829+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 226 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:51.914 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:51.847+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 377 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:53.182 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:53.090+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 225 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:04:56.959 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:04:56.954+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 227 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:04:58.215 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:04:58.162+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 378 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:04:59.759 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:04:59.398+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 236 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:03.667 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:03.665+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 231 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:04.695 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:04.688+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 238 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:04.978 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:04.976+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 384 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:11.135 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:11.118+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 239 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:11.284 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:10.957+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 245 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:11.533 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:11.321+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 401 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:16.745 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:16.643+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 242 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:18.425 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:18.421+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 252 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:18.925 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:18.839+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:26.177 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:26.172+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 251 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:26.693 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:26.646+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 253 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:26.950 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:26.946+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 412 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:32.268 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:32.051+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 431 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:33.459 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:33.438+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 253 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:34.756 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:34.747+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 254 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:38.635 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:38.568+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 435 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:39.904 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:39.888+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 255 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:41.597 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:41.567+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 256 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:45.920 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:45.916+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 442 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:47.277 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:46.938+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 257 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:47.724 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:47.721+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 273 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:52.611 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:52.608+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 464 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:52.660 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:52.658+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 257 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:54.322 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:54.178+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 288 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:05:58.821 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:05:58.805+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 259 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:05:59.906 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:05:59.851+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 483 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:05:59.919 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:05:59.917+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 300 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:04.120 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:04.013+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 259 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:05.707 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:05.705+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 329 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:07.729 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:07.638+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 491 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:06:10.223 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:10.221+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 259 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:11.283 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:11.101+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 339 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:14.830 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:14.796+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 498 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:06:18.259 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:18.085+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 263 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:19.180 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:19.100+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 349 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:23.677 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:23.651+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 510 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:06:25.477 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:25.472+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 283 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:25.566 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:25.508+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 349 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:32.117 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:32.116+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 522 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:06:33.414 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:33.394+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 357 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:34.470 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:34.466+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 286 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:38.576 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:38.573+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 553 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:06:41.274 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:41.254+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 358 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:42.338 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:42.335+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 290 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:44.019 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:44.017+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 564 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:06:48.300 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:48.278+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 358 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:48.624 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:48.606+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 304 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:51.422 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:51.371+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 578 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:06:55.153 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:06:54.986+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 358 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:06:55.383 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:06:55.328+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 304 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:06:56.855 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:06:56.764+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:00.978 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:00.975+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 304 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:01.978 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:01.730+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 358 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:02.093 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:01.995+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:06.301 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:06.298+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 323 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:08.103 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:07.790+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 584 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:10.259 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:10.223+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 360 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:14.068 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:14.066+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 593 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:14.662 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:14.654+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 325 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:16.879 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:16.687+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 362 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:19.708 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:19.706+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 325 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:22.071 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:21.978+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 363 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:22.308 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:22.302+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 612 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:24.972 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:24.904+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 327 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:28.595 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:28.526+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 617 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:29.904 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:29.885+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 369 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:30.739 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:30.737+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 327 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:35.185 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:35.128+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 640 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:35.908 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:35.905+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 329 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:36.173 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:36.139+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 374 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:41.169 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:41.084+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 651 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:41.307 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:41.212+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 374 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:42.057 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:42.014+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 329 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:47.603 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:47.494+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 377 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:48.195 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:48.109+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 679 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:50.529 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:50.412+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 329 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:52.831 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:52.711+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 377 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:07:53.927 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:07:53.871+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 688 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:07:57.888 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:07:57.879+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 329 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:07:58.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:07:58.181+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 377 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:01.141 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:00.986+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 705 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:03.755 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:03.307+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 334 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:03.926 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:03.903+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 383 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:07.765 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:07.683+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 731 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:10.364 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:10.321+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 342 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:12.574 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:12.157+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 388 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:15.650 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:15.500+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 744 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:17.809 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:17.793+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 345 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:19.435 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:19.399+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 388 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:21.602 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:21.479+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 747 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:25.405 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:25.285+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 363 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:26.285 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:26.259+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 404 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:29.952 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:29.934+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 755 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:32.841 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:32.535+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 371 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:32.875 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:32.841+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 407 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:35.310 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:35.150+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 767 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:38.549 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:38.530+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 371 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:39.157 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:39.154+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 409 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:44.454 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:44.376+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 409 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:44.563 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:44.522+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 773 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:45.771 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:45.478+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 375 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:50.214 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:49.900+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 409 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:50.562 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:50.527+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 781 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:08:54.656 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:08:54.578+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 390 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:08:55.812 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:08:55.778+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 411 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:08:56.860 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:08:56.840+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 787 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:02.243 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:02.021+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 393 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:02.570 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:02.418+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 411 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:02.888 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:02.794+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 794 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:08.190 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:08.015+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 395 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:09.330 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:09.325+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 827 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:09.733 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:09.684+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 411 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:15.290 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:15.245+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 397 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:15.306 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:15.286+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 834 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:16.071 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:16.054+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 411 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:23.078 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:23.040+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 412 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:23.392 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:23.337+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 857 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:23.433 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:23.220+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 410 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:28.359 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:28.273+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 412 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:28.771 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:28.752+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 862 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:28.884 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:28.852+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 414 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:34.222 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:33.969+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 415 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:35.405 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:35.334+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 412 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:36.299 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:36.244+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 898 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:40.071 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:40.025+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 415 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:42.743 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:42.741+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 416 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:44.284 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:44.142+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:48.700 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:48.538+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 417 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:50.993 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:50.955+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 416 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:51.790 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:51.752+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 938 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:09:57.459 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:09:57.175+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 416 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:09:58.075 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:09:57.975+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 423 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:09:59.588 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:09:59.526+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 957 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:03.658 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:03.561+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 416 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:07.030 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:06.666+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 425 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:07.098 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:06.923+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 965 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:11.185 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:10.902+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 416 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:13.185 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:13.183+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 429 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:14.078 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:14.050+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 973 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:17.073 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:17.037+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 416 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:20.466 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:20.430+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 988 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:21.264 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:21.251+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 446 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:23.592 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:23.534+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 416 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:25.724 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:25.673+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 998 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:29.308 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:29.020+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 452 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:31.175 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:31.173+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1005 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:31.365 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:31.326+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 423 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:36.087 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:35.834+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 455 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:36.201 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:36.181+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1006 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:38.623 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:38.494+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 431 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:41.300 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:41.203+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1033 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:43.446 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:42.937+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 455 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:44.814 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:44.811+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 431 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:49.264 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:49.024+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:49.867 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:49.850+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 457 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:52.378 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:52.274+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 437 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:10:56.275 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:10:56.109+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1072 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:10:58.788 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:10:58.462+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 458 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:10:59.215 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:10:59.087+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 456 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:01.191 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:01.110+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1072 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:04.641 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:03.800+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 458 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:05.637 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:05.476+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 468 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:07.214 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:07.211+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1072 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:11.274 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:11.012+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 472 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:11.799 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:11.445+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 479 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:12.442 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:12.360+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1076 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:17.423 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:17.403+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1076 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:17.802 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:17.612+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 486 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:19.147 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:19.137+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 482 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:22.565 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:22.552+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1076 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:22.791 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:22.762+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 488 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:24.695 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:24.693+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 506 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:29.776 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:29.722+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 506 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:30.111 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:30.086+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1076 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:30.596 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:30.477+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 491 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:36.638 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:36.636+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1093 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:36.752 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:36.683+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 491 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:38.575 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:38.571+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 518 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:44.310 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:44.122+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 518 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:44.510 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:44.491+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 493 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:45.671 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:45.472+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1100 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:49.918 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:49.917+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 522 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:52.342 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:52.319+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 502 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:11:52.392 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:52.339+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1101 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:55.099 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:11:54.966+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 524 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:11:58.584 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:11:58.471+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1128 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:11:58.910 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:11:58.907+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 504 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:00.356 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:00.181+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 528 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:05.242 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:05.183+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 532 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:05.896 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:05.874+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1129 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:07.502 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:07.495+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 530 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:12.013 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:12.009+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 534 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:12.522 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:12.520+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 531 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:12.539 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:12.504+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1129 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:18.179 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:17.959+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 537 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:18.579 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:17.981+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 531 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:19.986 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:19.916+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1129 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:24.259 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:24.181+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 544 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:24.479 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:24.186+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 539 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:26.209 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:26.159+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1129 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:30.933 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:30.922+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 542 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:31.288 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:31.286+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 570 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:33.604 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:33.426+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1135 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:38.896 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:38.881+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 575 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:39.555 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:39.229+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 551 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:39.638 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:39.552+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1148 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:44.320 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:44.279+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 555 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:45.337 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:44.792+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 580 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:48.299 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:47.886+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1158 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:51.797 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:51.795+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 584 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:52.889 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:52.822+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 564 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:53.654 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:53.634+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1167 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:12:58.499 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:12:58.478+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 585 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:12:59.038 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:12:59.035+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 571 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:12:59.392 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:12:59.324+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1176 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:06.058 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:05.918+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 585 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:06.580 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:06.462+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1192 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:07.520 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:13:07.415+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 573 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:13:12.360 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:12.141+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 585 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:14.946 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:14.821+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1201 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:17.571 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:13:17.232+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 577 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:13:17.815 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:17.811+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 588 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:20.440 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:20.091+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1210 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:23.208 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:23.083+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 602 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:23.353 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:13:23.246+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 582 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:13:26.590 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:26.463+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1218 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:29.124 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:13:28.756+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 582 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:13:30.836 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:30.834+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 629 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:34.476 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:34.237+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1244 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:35.921 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:13:35.760+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 584 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:13:36.254 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:36.251+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 629 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:40.957 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:40.937+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1263 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:41.367 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:41.366+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 629 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:45.939 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:13:45.634+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 584 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:13:46.451 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:46.425+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 634 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:46.785 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:46.782+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1268 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:51.678 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:51.675+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 635 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:13:54.190 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:13:54.184+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1289 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:13:58.982 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:13:58.980+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 584 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:13:58.992 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:13:58.969+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 635 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:00.561 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:00.496+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1309 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:06.915 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:06.830+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 635 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:06.975 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:06.915+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1327 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:08.807 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:08.570+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 584 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:14:14.959 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:14.584+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 635 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:15.530 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:15.144+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 584 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:14:15.865 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:15.430+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:22.099 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:22.092+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1371 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:22.547 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:22.465+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 652 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:23.558 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:23.474+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 584 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:14:28.021 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:28.002+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 659 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:30.732 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:30.582+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1403 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:32.148 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:31.810+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 584 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:14:33.460 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:33.224+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 673 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:36.757 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:36.723+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1423 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:38.924 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:38.904+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 673 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:39.812 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:39.809+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:14:43.255 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:43.110+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1444 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:44.437 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:44.404+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 673 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:46.229 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:46.071+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:14:50.251 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:50.206+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 673 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:50.607 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:50.540+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1467 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:53.632 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:53.476+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:14:58.490 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:14:58.294+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1480 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:14:59.447 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:14:59.395+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 685 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:14:59.601 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:14:59.600+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:05.543 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:05.540+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1506 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:05.579 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:05.469+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:05.862 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:05.860+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 685 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:11.643 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:11.639+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1521 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:15.413 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:14.830+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 689 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:17.569 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:16.630+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:18.220 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:18.164+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1540 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:20.782 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:20.744+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 690 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:23.657 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:23.655+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:26.042 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:25.655+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1546 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:27.421 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:27.229+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 709 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:30.710 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:30.666+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:32.085 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:31.946+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1552 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:33.193 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:33.144+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 727 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:38.530 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:38.138+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:39.717 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:39.653+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1566 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:41.204 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:41.202+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 743 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:44.832 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:44.687+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:46.208 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:46.201+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1596 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:48.433 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:48.399+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 753 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:51.990 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:51.894+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1611 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:52.001 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:51.797+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:15:54.586 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:15:54.506+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 769 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:15:57.202 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:15:57.073+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1611 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:15:59.761 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:15:59.603+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:01.422 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:01.274+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 780 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:02.835 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:02.526+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1635 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:08.138 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:07.904+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 808 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:08.336 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:08.179+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1644 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:10.857 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:16:10.801+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:13.679 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:13.476+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1644 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:14.930 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:14.852+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 812 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:19.096 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:18.784+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1663 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:20.245 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:16:20.192+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 587 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:23.739 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:23.718+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 812 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:23.838 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:23.796+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1664 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:27.443 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:16:27.411+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 591 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:29.265 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:29.263+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1664 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:30.118 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:30.026+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 812 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:34.713 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:34.663+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1671 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:34.950 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:16:34.678+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 592 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:39.301 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:39.299+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 831 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:41.554 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:41.551+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1698 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:41.621 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:16:41.605+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 593 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:44.820 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:44.707+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 841 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:46.814 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:46.811+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1710 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:47.833 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:16:47.693+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 595 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:50.756 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:50.439+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 863 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:52.490 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:52.470+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1710 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:16:55.652 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:16:55.648+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 599 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:16:56.276 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:16:56.240+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 884 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:16:57.638 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:16:57.619+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1711 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:01.515 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:01.365+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 599 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:01.724 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:01.653+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 896 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:04.640 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:04.598+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1722 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:07.574 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:07.490+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 599 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:08.625 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:08.107+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 907 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:13.067 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:13.020+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1739 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:13.199 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:13.195+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 599 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:16.405 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:16.403+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 912 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:19.567 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:19.285+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1771 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:20.285 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:20.256+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 601 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:22.767 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:22.725+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 925 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:26.182 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:26.180+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1780 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:27.095 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:26.856+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 601 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:29.977 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:29.974+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 937 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:31.814 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:31.760+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1807 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:33.729 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:33.727+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 601 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:37.198 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:36.858+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 957 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:37.954 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:37.952+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1812 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:42.387 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:42.341+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 621 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:44.194 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:44.189+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 957 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:44.436 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:44.345+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1812 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:50.122 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:49.752+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 957 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:50.805 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:50.803+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 623 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:17:51.022 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:50.916+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1814 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:55.765 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:17:55.472+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 973 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:17:56.389 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:17:56.354+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1822 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:17:57.002 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:17:56.999+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 631 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:02.238 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:02.203+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1835 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:04.014 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:03.811+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 979 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:04.557 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:04.416+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 631 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:07.744 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:07.740+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1852 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:10.515 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:10.491+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 987 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:11.142 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:11.001+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 632 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:14.934 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:14.908+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1856 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:16.002 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:15.894+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 997 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:17.122 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:17.120+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 651 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:22.467 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:22.399+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1870 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:22.849 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:22.847+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 651 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:23.870 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:23.705+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 997 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:27.961 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:27.942+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1889 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:30.191 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:30.052+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 997 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:30.414 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:30.202+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 653 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:33.406 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:33.379+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1899 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:35.952 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:35.930+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 997 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:38.601 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:38.582+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1917 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:38.891 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:38.520+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 655 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:43.886 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:43.808+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1928 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:45.142 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:45.121+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 997 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:46.530 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:46.246+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 657 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:49.371 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:49.353+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1936 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:51.510 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:18:51.476+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1018 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:18:54.302 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:54.282+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 657 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:18:54.766 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:54.615+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1944 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:59.965 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:18:59.894+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1953 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:18:59.989 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:18:59.986+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 659 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:00.214 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:00.000+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1046 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:05.765 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:05.762+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1963 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:08.473 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:08.470+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1071 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:09.212 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:19:08.708+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 659 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:14.346 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:14.342+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1973 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:15.362 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:19:15.334+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 659 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:16.234 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:16.175+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1075 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:20.424 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:20.420+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 1990 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:22.846 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:19:22.541+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 661 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:22.901 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:22.864+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1080 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:28.607 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:28.467+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2023 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:29.551 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:29.469+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1084 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:32.701 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:19:32.698+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 665 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:34.435 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:34.332+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2030 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:34.668 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:34.666+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1084 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:39.839 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:39.835+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2048 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:41.358 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:41.190+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1084 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:41.593 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:19:41.430+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 670 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:46.395 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:46.391+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1084 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:47.182 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:47.053+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2050 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:49.022 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:19:49.020+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 687 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:51.859 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:51.706+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1084 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:52.954 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:52.838+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2062 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:19:56.924 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:19:56.846+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1087 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:19:57.163 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:19:56.918+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 695 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:19:59.962 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:19:59.959+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2079 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:01.946 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:01.868+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1089 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:03.892 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:03.808+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 695 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:07.270 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:06.956+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1093 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:08.360 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:08.248+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2110 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:11.206 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:11.152+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:12.019 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:12.017+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1098 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:13.922 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:13.864+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2131 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:18.439 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:18.329+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:19.657 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:19.569+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1102 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:19.921 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:19.887+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2139 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:24.913 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:24.910+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:26.669 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:26.665+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2153 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:26.903 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:26.764+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1102 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:33.014 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:33.013+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2163 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:33.771 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:33.456+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:34.916 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:34.894+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1119 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:38.680 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:38.679+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:40.475 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:40.458+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2184 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:42.624 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:42.621+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1119 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:45.591 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:45.589+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:48.123 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:48.115+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2221 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:51.606 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:50.817+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1128 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:20:54.089 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:20:54.026+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2236 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:20:54.999 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:20:54.998+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:20:57.766 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:20:57.336+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1155 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:00.690 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:00.673+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:01.152 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:01.104+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2249 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:02.601 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:02.553+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1178 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:07.732 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:07.350+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:08.901 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:08.898+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1178 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:09.484 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:09.481+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2250 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:15.293 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:15.276+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2264 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:15.332 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:15.313+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:17.532 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:17.465+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1178 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:22.966 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:22.830+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2269 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:23.116 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:23.005+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:23.902 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:23.899+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1178 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:30.390 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:30.257+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2291 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:30.533 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:30.531+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:32.618 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:31.916+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1188 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:35.815 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:35.540+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2306 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:37.704 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:37.698+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:38.454 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:38.450+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1207 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:40.981 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:40.675+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2306 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:44.845 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:44.259+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:44.871 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:44.731+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1237 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:46.044 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:46.041+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2306 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:49.963 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:49.726+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:52.256 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:21:52.148+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1239 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:21:52.785 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:52.782+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2315 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:21:58.869 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:21:58.605+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 698 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:21:59.249 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:21:59.230+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2329 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:01.623 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:01.127+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1250 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:04.626 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:04.586+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 698 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:06.784 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:06.577+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2344 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:09.925 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:09.924+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1272 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:12.137 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:11.975+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 702 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:12.487 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:12.375+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2361 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:17.222 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:17.143+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1292 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:18.279 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:18.146+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 707 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:19.171 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:19.065+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2373 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:24.670 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:24.574+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1296 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:25.098 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:25.055+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 713 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:25.472 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:25.437+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2373 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:31.975 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:31.957+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 713 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:32.559 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:32.318+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1296 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:32.560 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:32.550+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2382 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:38.116 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:37.814+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 737 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:38.738 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:38.736+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1296 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:39.179 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:39.074+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2382 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:44.312 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:42.831+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 737 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:45.109 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:44.840+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2389 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:46.522 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:46.521+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1299 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:47.834 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:47.833+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 739 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:50.911 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:50.903+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2403 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:22:54.522 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:22:54.497+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1327 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:22:55.136 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:22:54.904+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 740 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:22:58.568 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:22:58.148+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2411 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:00.082 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:00.062+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1341 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:02.977 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:02.724+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 740 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:05.606 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:05.374+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1341 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:06.739 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:06.623+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2411 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:11.350 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:10.638+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 746 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:11.406 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:11.351+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1352 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:13.143 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:13.103+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2411 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:17.225 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:16.720+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1358 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:17.587 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:17.571+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 755 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:19.528 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:19.494+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2415 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:23.993 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:23.811+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1360 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:24.742 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:24.249+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 755 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:26.751 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:26.531+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2425 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:29.865 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:29.791+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1385 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:32.534 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:32.393+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 757 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:33.284 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:33.236+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2425 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:35.703 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:35.592+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1387 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:39.150 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:39.147+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2425 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:41.055 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:41.052+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1387 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:42.238 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:41.680+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 760 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:45.427 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:45.423+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2425 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:46.072 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:46.054+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1395 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:48.289 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:48.226+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 768 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:51.616 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:51.506+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1396 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:53.008 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:52.909+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2425 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:23:58.917 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:23:58.819+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1396 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:23:58.948 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:23:58.721+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 777 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:23:59.087 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:23:59.014+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2429 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:03.952 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:03.903+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1396 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:07.063 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:06.827+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2432 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:07.389 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:07.248+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 812 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:10.891 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:10.694+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1396 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:15.726 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:15.471+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2438 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:16.316 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:16.312+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 822 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:17.494 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:17.400+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1396 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:21.729 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:21.554+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2457 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:23.956 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:23.876+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1396 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:24.522 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:23.833+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 826 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:30.566 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:30.404+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2464 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:31.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:31.228+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1397 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:31.246 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:31.202+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 864 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:38.879 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:38.825+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2466 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:38.945 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:38.834+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1397 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:39.863 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:39.742+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 878 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:45.221 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:45.030+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2470 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:46.180 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:45.363+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 884 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:46.944 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:46.701+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1397 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:52.257 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:52.046+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 894 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:52.302 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:51.877+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2476 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:53.007 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:53.004+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1397 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:24:57.991 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:24:57.956+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2479 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:24:59.149 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:24:59.146+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 901 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:24:59.542 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:24:59.442+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:04.479 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:04.332+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2505 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:05.560 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:05.114+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 903 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:08.219 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:08.185+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1406 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:11.408 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:11.373+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2511 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:11.682 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:11.601+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 903 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:16.408 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:16.366+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1406 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:18.673 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:18.655+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2511 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:18.713 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:18.710+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 915 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:22.784 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:22.782+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1407 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:24.740 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:24.673+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2511 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:27.359 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:27.358+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 934 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:29.034 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:28.874+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1419 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:33.019 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:32.997+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2529 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:35.860 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:35.326+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1433 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:35.925 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:35.877+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 951 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:38.637 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:38.618+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2545 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:41.712 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:41.707+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1458 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:41.978 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:41.858+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 954 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:46.566 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:45.497+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2545 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:48.348 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:48.270+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1474 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:50.308 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:50.065+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 956 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:51.393 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:51.376+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2545 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:25:54.510 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:25:54.388+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1497 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:25:56.551 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:25:56.248+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 960 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:25:57.989 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:25:57.956+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2545 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:01.263 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:01.011+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1498 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:05.260 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:04.868+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 965 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:06.226 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:06.159+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2566 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:07.958 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:07.880+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1498 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:13.329 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:13.261+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 985 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:13.636 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:13.540+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2575 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:14.600 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:14.167+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1500 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:19.429 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:19.351+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1500 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:19.592 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:19.571+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2575 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:22.500 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:21.341+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1006 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:25.539 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:25.201+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1500 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:25.973 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:25.920+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:28.384 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:27.674+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1015 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:31.869 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:31.858+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1509 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:33.099 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:33.096+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2583 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:35.361 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:35.195+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1024 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:37.159 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:37.155+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1509 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:38.853 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:38.758+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2583 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:42.071 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:41.738+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1045 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:42.816 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:42.312+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1509 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:45.892 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:45.873+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2583 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:47.288 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:46.971+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1052 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:49.297 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:48.933+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1531 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:51.284 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:51.276+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2587 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:53.958 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:53.936+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1531 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:26:55.648 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:26:55.291+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1055 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:26:57.460 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:26:57.457+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2602 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:26:59.036 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:26:58.951+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1531 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:01.044 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:00.421+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1057 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:27:04.351 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:04.349+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1533 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:04.488 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:04.250+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2607 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:08.315 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:07.888+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1057 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:27:09.645 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:09.583+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1535 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:10.725 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:10.539+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2611 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:14.575 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:14.257+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1060 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:27:16.957 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:16.692+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1535 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:17.148 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:17.098+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2625 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:19.560 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:19.497+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1075 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:27:23.305 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:23.304+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2632 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:24.523 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:24.513+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:27:24.940 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:24.938+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1535 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:30.516 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:30.197+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1541 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:31.943 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:31.676+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2670 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:34.775 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:34.289+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:27:38.095 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:37.913+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1547 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:38.662 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:38.576+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2673 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:44.184 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:44.181+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1090 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:27:46.509 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:46.307+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1547 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:46.618 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:46.615+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2679 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:54.354 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:27:54.348+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1547 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:27:55.940 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:27:55.884+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2684 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:27:57.526 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:27:57.401+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1125 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:00.246 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:00.069+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:01.634 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:01.611+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2684 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:02.932 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:02.483+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1130 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:05.451 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:05.447+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:06.786 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:06.716+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2695 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:10.898 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:10.895+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1136 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:13.190 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:13.007+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:14.000 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:13.996+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2713 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:16.179 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:16.176+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1144 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:18.933 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:18.772+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:21.422 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:21.411+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1153 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:21.573 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:21.529+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2729 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:25.928 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:25.872+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:27.678 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:27.673+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1153 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:28.972 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:28.887+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2734 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:31.180 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:31.177+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1551 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:33.766 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:33.583+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1158 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:35.020 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:34.907+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2747 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:37.730 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:37.628+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1564 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:40.080 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:40.038+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1159 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:40.955 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:40.877+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2760 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:45.085 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:45.067+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1570 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:48.173 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:48.143+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2777 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:48.397 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:48.240+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1162 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:28:50.629 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:50.608+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1570 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:57.214 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:28:57.211+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2797 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:28:58.393 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:28:58.184+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1570 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:28:58.749 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:28:58.074+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1171 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:04.065 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:03.855+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2806 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:04.066 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:04.031+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1175 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:06.577 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:06.525+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1574 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:10.478 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:10.382+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1191 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:13.019 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:13.015+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2813 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:14.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:14.190+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1587 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:15.975 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:15.608+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1193 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:19.498 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:19.479+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2820 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:20.678 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:20.525+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1589 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:20.771 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:20.728+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1194 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:25.752 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:25.730+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2824 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:26.726 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:26.325+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1593 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:29.243 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:28.790+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1211 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:32.430 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:32.300+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2824 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:34.130 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:34.092+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1593 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:34.598 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:34.441+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1211 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:39.071 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:39.069+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2833 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:41.963 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:41.931+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1211 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:42.417 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:42.108+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1600 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:47.376 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:47.285+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2843 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:48.856 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:48.733+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1216 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:29:49.616 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:49.589+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1600 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:53.183 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:29:53.145+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2844 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:29:56.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:29:56.115+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1600 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:29:57.964 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:29:57.711+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1221 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:00.126 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:00.107+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2844 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:05.030 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:04.843+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1611 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:06.770 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:06.696+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2846 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:08.061 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:07.452+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1230 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:13.112 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:13.093+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1235 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:13.130 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:13.125+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1611 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:13.168 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:13.115+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2855 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:20.212 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:20.196+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1241 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:20.306 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:20.213+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2856 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:20.532 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:20.504+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:26.205 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:26.203+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2862 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:28.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:28.229+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:30.466 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:30.370+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1270 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:33.829 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:33.607+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:33.925 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:33.905+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2862 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:36.778 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:36.762+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1279 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:38.897 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:38.781+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:42.289 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:42.180+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2862 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:44.475 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:44.472+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1304 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:45.423 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:45.398+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:49.738 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:49.654+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2862 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:52.028 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:51.667+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1620 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:52.841 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:52.691+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1317 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:30:55.875 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:30:55.795+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2862 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:30:58.827 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:30:58.747+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1626 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:30:59.898 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:30:59.855+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1335 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:02.206 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:02.022+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2881 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:04.227 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:04.067+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1627 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:05.745 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:05.000+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1340 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:08.439 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:08.321+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2881 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:09.649 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:09.581+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1641 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:10.674 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:10.629+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1356 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:14.453 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:14.432+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2881 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:14.798 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:14.586+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1641 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:16.532 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:16.283+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1364 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:20.881 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:19.610+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1641 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:21.523 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:21.310+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2881 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:23.451 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:23.370+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1370 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:25.830 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:25.810+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1649 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:27.360 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:27.311+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2881 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:31.753 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:31.646+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1376 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:32.249 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:32.214+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1666 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:34.029 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:33.914+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2884 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:38.784 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:38.685+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1381 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:39.301 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:39.299+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1698 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:40.763 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:40.745+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2891 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:45.612 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:45.586+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1394 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:46.988 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:46.984+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2897 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:47.378 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:47.201+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1698 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:52.409 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:52.290+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1398 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:31:53.190 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:53.183+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1698 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:53.712 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:31:53.637+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2917 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:31:58.510 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:31:58.413+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1698 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:31:59.534 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:31:59.529+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1401 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:01.019 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:01.000+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2936 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:03.963 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:03.656+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1700 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:04.666 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:04.663+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1407 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:07.161 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:07.160+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2948 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:09.288 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:09.272+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1700 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:10.073 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:09.693+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1407 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:14.359 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:14.282+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1700 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:14.431 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:14.280+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2962 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:15.854 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:15.705+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1413 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:21.387 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:21.370+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2976 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:22.443 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:22.245+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1700 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:24.389 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:24.168+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1430 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:27.539 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:27.520+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1700 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:28.659 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:28.481+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2982 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:30.784 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:30.587+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1431 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:33.643 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:33.636+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1700 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:34.434 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:34.160+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2985 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:37.344 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:37.032+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1449 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:39.462 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:39.460+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1702 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:40.527 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:40.358+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 2998 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:45.629 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:45.625+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1702 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:47.617 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:47.614+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3004 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:49.156 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:48.582+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1454 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:53.277 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:53.012+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3014 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:53.385 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:53.380+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1702 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:32:58.718 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:32:58.173+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1461 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:32:59.723 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:32:59.485+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3027 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:32:59.870 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:32:59.868+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1702 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:04.200 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:04.052+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1465 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:06.453 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:06.389+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1702 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:07.020 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:06.914+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3049 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:10.850 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:10.491+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1469 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:12.920 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:12.744+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3057 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:14.658 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:14.656+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:18.559 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:18.401+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1469 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:20.501 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:20.397+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:22.217 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:22.216+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:25.588 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:25.384+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1469 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:26.863 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:26.748+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3076 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:27.778 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:27.777+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:33.070 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:32.838+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:34.680 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:34.638+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1481 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:35.316 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:35.312+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3094 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:39.279 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:39.167+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:40.816 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:40.774+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3131 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:41.792 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:41.656+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1485 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:46.516 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:46.431+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:48.774 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:48.681+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1496 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:48.820 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:48.519+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3149 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:54.056 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:53.735+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:33:54.215 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:33:53.683+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1505 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:33:55.513 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:33:55.507+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3157 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:33:59.252 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:33:59.183+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:01.487 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:01.087+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1505 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:03.114 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:03.028+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3202 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:04.761 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:04.552+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:09.591 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:09.578+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:09.853 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:09.600+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1505 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:10.631 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:10.628+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3216 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:15.891 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:15.626+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:16.227 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:16.211+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3246 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:19.325 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:18.535+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1506 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:20.928 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:20.728+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:23.089 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:22.972+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3260 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:27.013 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:26.889+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:28.096 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:28.083+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1521 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:30.593 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:30.259+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3282 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:33.194 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:33.172+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1521 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:34.293 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:34.260+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1706 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:36.588 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:36.303+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3294 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:38.325 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:38.179+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1521 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:41.086 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:41.080+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1712 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:43.240 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:43.185+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1521 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:43.731 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:43.387+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:48.619 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:48.597+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1521 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:34:48.873 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:48.867+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1715 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:50.627 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:50.625+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3336 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:55.267 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:34:55.213+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1715 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:34:55.902 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:34:55.794+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3356 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:34:56.058 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:34:55.811+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1522 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:03.099 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:03.078+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1715 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:03.331 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:03.311+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3375 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:35:05.880 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:05.582+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1534 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:10.770 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:10.696+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:35:10.937 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:10.575+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1715 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:11.230 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:10.927+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1536 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:18.026 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:17.870+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3394 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:35:18.686 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:18.620+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1717 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:20.052 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:19.938+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1541 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:23.764 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:23.731+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1717 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:26.197 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:25.933+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3405 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:35:28.853 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:28.836+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1729 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:28.882 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:28.859+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1543 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:34.023 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:33.903+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1731 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:34.528 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:34.480+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3414 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:35:35.254 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:35.141+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1543 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:40.868 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:40.743+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1738 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:42.080 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:42.032+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3443 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:35:42.889 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:42.883+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1544 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:48.288 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:48.244+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1738 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:49.792 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:49.788+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1572 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:52.368 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:52.210+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3443 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:35:53.909 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:35:53.905+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1738 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:35:56.605 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:35:56.560+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1580 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:35:59.276 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:35:59.270+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:00.833 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:00.751+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1738 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:04.526 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:04.479+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1589 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:05.840 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:05.837+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:09.425 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:09.326+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1740 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:12.038 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:12.002+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:14.177 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:13.438+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1598 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:16.927 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:16.925+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1759 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:19.327 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:19.325+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:20.396 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:19.681+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1604 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:24.633 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:24.631+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1761 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:25.202 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:25.159+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:25.297 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:25.237+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1608 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:30.612 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:30.531+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1608 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:30.897 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:30.614+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1774 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:31.819 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:31.782+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:36.565 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:36.563+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1613 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:37.093 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:37.060+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1798 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:39.002 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:38.905+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:42.480 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:42.465+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1623 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:43.788 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:43.433+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1819 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:45.859 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:45.853+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:51.149 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:50.779+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1819 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:36:52.359 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:36:52.222+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3472 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:36:53.736 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:53.484+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1631 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:36:56.839 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:36:56.833+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1824 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:00.225 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:36:59.580+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1634 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:00.266 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:00.213+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3505 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:04.872 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:04.727+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1634 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:04.894 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:04.791+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1827 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:08.296 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:08.050+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3532 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:11.668 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:11.649+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1636 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:13.052 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:13.016+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1832 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:15.046 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:14.836+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3540 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:16.727 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:16.694+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1636 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:19.961 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:19.943+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1836 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:23.463 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:23.377+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3550 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:25.737 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:25.188+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1636 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:26.645 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:26.551+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1837 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:29.037 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:28.976+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3570 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:31.094 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:31.010+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1638 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:32.781 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:32.701+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1839 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:37.190 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:37.044+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3570 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:37.641 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:37.122+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1640 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:39.927 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:39.925+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1839 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:43.799 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:43.743+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3570 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:46.466 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:46.416+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1842 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:46.632 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:46.414+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1642 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:50.107 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:50.072+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3578 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:52.962 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:52.961+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1842 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:37:53.806 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:37:53.427+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1642 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:37:56.463 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:37:56.442+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3581 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:37:59.618 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:37:59.608+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1842 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:01.646 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:01.592+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1643 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:06.616 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:06.590+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3591 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:38:07.854 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:07.376+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1643 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:08.529 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:08.308+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1855 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:14.624 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:14.575+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3606 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:38:15.217 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:15.136+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1650 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:15.376 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:15.373+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1855 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:21.740 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:21.721+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3628 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:38:22.335 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:22.334+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1855 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:24.663 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:23.629+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1653 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:28.602 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:28.525+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3645 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:38:28.612 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:28.593+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1855 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:30.933 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:30.828+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1664 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:35.272 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:35.213+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1874 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:35.752 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:35.489+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3645 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:38:36.583 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:36.289+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1669 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:42.760 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:42.756+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1889 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:43.443 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:43.348+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3647 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:38:44.617 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:44.302+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1669 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:49.180 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:49.159+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3657 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:38:49.404 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:49.173+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1903 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:54.578 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:38:54.572+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1669 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:38:55.657 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:38:55.621+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1918 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:38:56.631 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:38:56.596+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3674 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:04.068 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:04.044+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3674 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:04.079 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:03.903+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1922 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:05.145 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:39:04.637+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1671 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:39:10.085 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:10.076+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3674 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:11.722 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:11.710+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1935 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:17.424 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:39:17.128+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1686 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:39:18.023 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:17.995+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3674 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:19.745 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:19.743+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1937 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:25.520 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:25.509+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3704 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:26.381 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:26.361+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1941 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:30.793 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:39:30.777+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:39:33.289 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:33.272+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1950 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:33.713 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:33.392+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3726 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:38.733 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:38.534+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3732 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:39.961 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:39.958+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1959 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:42.207 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:39:41.506+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:39:46.425 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:46.421+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3778 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:48.624 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:48.461+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1965 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:50.233 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:39:50.230+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:39:52.788 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:52.701+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3787 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:39:54.113 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:39:53.939+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1967 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:39:59.968 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:39:59.694+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3821 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:01.046 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:00.618+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:01.811 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:01.809+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1969 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:06.106 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:06.041+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3825 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:10.416 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:10.391+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:10.774 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:10.771+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1969 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:14.088 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:13.943+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3856 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:16.544 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:16.526+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:18.902 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:18.743+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1969 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:20.026 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:19.978+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3858 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:22.572 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:22.450+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:24.934 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:24.831+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1970 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:26.419 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:26.380+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3887 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:28.523 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:28.518+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:31.305 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:31.282+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1970 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:31.837 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:31.834+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3893 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:33.709 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:33.707+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:37.772 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:37.732+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1970 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:38.047 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:37.964+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3902 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:38.942 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:38.926+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:44.176 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:44.149+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1970 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:44.244 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:44.140+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:45.898 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:45.876+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3934 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:52.110 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:52.004+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3952 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:40:52.580 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:40:52.576+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1970 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:40:54.904 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:40:54.901+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:40:58.063 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:40:58.028+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3981 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:01.125 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:00.652+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 1973 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:04.767 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:04.765+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:04.779 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:04.690+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 3996 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:08.125 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:08.123+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2000 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:11.478 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:11.472+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:11.660 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:11.537+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4015 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:14.548 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:14.480+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2012 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:19.040 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:19.009+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4030 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:19.670 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:19.649+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2012 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:20.838 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:20.784+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:25.090 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:24.846+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4051 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:27.574 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:27.370+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2012 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:30.188 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:30.185+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:32.099 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:32.095+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4088 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:34.093 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:34.070+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2012 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:37.757 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:37.376+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:39.566 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:39.374+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2012 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:39.886 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:39.807+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4110 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:42.664 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:42.384+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:46.246 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:46.243+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2023 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:48.235 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:48.062+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4144 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:50.022 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:49.087+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:53.777 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:53.700+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2029 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:41:55.020 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:41:54.786+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:41:55.181 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:41:55.105+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4167 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:41:58.709 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:41:58.706+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2035 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:00.455 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:00.345+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:01.889 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:01.816+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4167 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:07.906 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:07.789+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2060 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:08.058 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:07.962+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4167 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:08.236 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:08.217+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:13.535 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:13.430+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:15.128 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:15.030+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4167 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:16.050 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:15.740+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2062 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:18.566 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:18.564+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:22.955 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:22.953+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4167 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:22.992 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:22.973+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2062 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:29.164 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:29.162+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1697 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:32.234 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:32.232+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4173 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:32.288 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:32.270+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2062 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:36.032 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:36.021+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1701 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:38.435 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:38.414+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2062 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:40.670 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:40.633+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4184 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:42.991 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:42.977+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1703 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:44.984 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:44.954+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2064 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:47.685 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:47.604+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4209 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:51.593 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:42:51.577+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1719 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:42:52.015 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:51.947+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2079 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:42:53.702 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:53.648+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4215 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:42:58.619 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:42:58.598+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2091 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:43:00.012 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:42:59.956+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4215 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:01.445 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:00.435+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1721 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:07.513 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:43:07.464+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2097 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:43:08.272 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:08.217+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1727 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:08.682 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:08.462+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4215 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:14.126 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:13.814+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1746 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:15.367 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:15.269+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4215 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:17.699 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:43:17.328+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2114 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:43:23.489 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:23.430+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1750 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:23.918 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:23.672+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4215 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:28.529 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:43:28.497+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2141 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:43:31.675 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:31.636+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1756 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:32.583 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:31.791+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4225 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:37.928 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:37.920+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4239 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:38.604 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:43:38.602+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2141 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:43:39.466 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:39.385+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1756 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:44.730 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:43:44.547+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2141 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:43:45.380 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:44.916+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4239 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:46.241 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:45.542+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1757 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:52.068 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:51.984+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4239 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:43:52.311 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:43:52.214+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2141 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:43:55.016 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:43:54.743+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1758 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:43:58.976 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:43:58.737+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4239 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:00.166 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:43:59.977+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2141 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:02.757 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:02.531+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1758 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:04.990 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:44:04.889+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4239 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:05.810 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:44:05.693+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2141 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:09.497 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:09.153+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1758 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:12.501 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:44:12.464+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2141 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:13.116 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:44:13.004+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4269 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:16.025 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:15.838+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1758 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:21.933 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:44:21.718+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2151 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:22.074 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:44:21.389+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4275 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:22.733 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:22.729+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1758 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:28.568 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:44:28.566+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4304 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:31.881 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:44:31.879+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2171 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:33.120 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:32.975+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1760 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:39.146 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:44:39.082+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4304 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:40.029 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:44:40.011+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2208 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:40.175 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:40.171+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1762 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:44.108 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:44:44.089+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4304 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:48.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:44:48.035+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2208 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:48.089 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:47.936+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1766 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:51.399 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:44:51.380+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4304 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:44:54.344 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:44:54.296+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2208 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:44:55.239 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:54.193+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1766 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:44:59.699 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:44:59.273+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1766 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:45:00.186 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:00.168+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4304 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:00.672 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:00.665+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2208 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:07.956 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:07.907+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4304 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:08.076 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:07.950+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2208 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:08.144 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:45:08.141+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1766 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:45:15.944 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:15.710+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4304 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:16.610 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:45:16.190+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1767 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:45:16.898 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:16.464+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2208 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:23.177 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:23.174+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:23.293 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:23.275+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2208 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:24.835 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:45:24.717+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1770 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:45:30.060 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:30.010+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:30.510 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:30.507+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2232 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:34.104 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:45:34.035+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1770 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:45:36.455 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:36.452+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:40.009 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:39.472+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2282 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:42.828 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:45:42.537+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1770 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:45:44.689 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:44.578+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2292 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:46.359 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:45.975+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:50.725 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:45:50.668+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1773 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:45:53.409 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:45:52.930+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:45:55.256 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:45:55.151+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2300 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:45:58.693 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:45:58.633+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1777 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:00.238 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:00.235+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:00.812 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:00.599+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2312 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:05.876 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:05.855+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:07.427 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:07.314+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:07.533 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:46:07.529+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1785 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:14.037 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:46:14.034+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1785 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:14.675 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:14.583+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2370 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:14.903 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:14.840+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:21.383 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:21.226+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:21.606 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:21.468+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2404 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:23.827 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:46:22.687+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1785 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:27.479 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:27.476+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:28.206 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:28.196+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2406 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:34.511 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:46:34.404+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1787 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:34.797 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:34.795+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2439 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:35.212 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:35.207+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:40.856 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:46:40.552+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1790 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:43.342 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:43.035+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:43.654 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:43.567+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2474 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:46.167 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:46:46.163+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1796 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:50.390 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:50.385+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2484 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:51.108 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:51.099+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:46:54.545 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:46:54.472+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1805 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:46:57.052 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:46:57.047+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2507 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:46:58.417 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:46:58.138+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4310 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:02.125 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:02.100+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1818 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:47:06.184 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:06.089+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2533 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:09.544 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:09.521+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1830 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:47:10.790 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:47:10.788+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4314 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:14.113 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:14.012+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2554 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:17.149 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:17.105+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1830 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:47:20.696 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:47:20.540+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4321 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:21.063 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:21.060+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2576 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:23.691 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:23.661+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1848 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:47:26.516 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:26.509+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2589 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:27.460 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:47:27.144+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4321 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:30.980 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:30.723+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1856 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:47:32.576 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:32.525+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2596 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:32.921 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:47:32.894+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4321 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:39.048 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:38.990+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2596 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:40.757 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:47:40.703+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4321 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:41.257 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:41.006+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1876 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:47:45.691 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:45.587+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2598 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:46.350 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:47:46.329+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4321 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:47.466 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:47.274+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1878 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:47:53.661 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:47:53.531+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4321 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:47:53.824 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:47:53.784+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2610 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:47:56.257 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:47:56.095+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1900 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:00.230 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:00.194+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4321 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:00.503 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:00.404+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2625 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:02.394 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:02.286+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1905 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:06.540 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:06.278+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4330 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:07.075 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:06.970+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2627 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:08.542 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:08.539+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1907 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:11.917 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:11.902+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4338 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:12.323 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:12.041+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2646 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:16.033 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:16.015+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1909 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:19.234 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:19.092+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2658 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:19.355 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:19.277+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4360 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:21.169 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:21.150+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1909 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:26.403 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:26.400+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4371 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:27.110 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:27.045+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2677 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:28.658 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:28.612+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1909 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:32.822 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:32.604+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4386 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:34.102 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:34.099+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2685 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:38.847 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:38.334+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1913 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:39.088 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:39.086+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4394 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:41.924 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:41.553+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:44.846 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:44.673+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4406 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:49.301 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:49.164+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1915 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:48:50.278 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:50.276+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2712 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:52.552 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:48:52.533+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4421 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:48:55.756 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:48:55.755+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2724 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:48:56.210 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:48:56.149+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1919 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:00.376 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:00.327+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4424 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:03.069 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:03.031+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2724 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:04.488 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:04.424+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1919 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:08.431 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:08.412+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4424 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:09.752 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:09.488+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2724 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:11.519 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:11.440+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1919 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:14.054 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:14.048+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4424 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:16.477 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:16.381+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2724 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:21.211 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:21.205+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1919 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:22.146 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:22.080+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4438 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:22.413 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:22.336+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2724 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:27.197 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:26.950+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1921 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:28.379 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:28.375+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4438 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:28.383 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:28.360+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2726 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:35.597 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:35.485+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1933 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:36.998 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:36.824+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4440 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:37.649 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:37.629+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2739 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:41.557 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:41.515+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1933 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:42.871 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:42.853+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4442 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:43.903 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:43.230+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2752 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:48.910 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:48.258+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1940 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:49:48.916 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:48.871+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4462 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:51.774 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:51.697+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2758 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:49:55.225 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:49:55.171+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4462 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:49:56.539 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:49:55.894+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1941 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:00.050 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:49:59.973+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2805 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:01.412 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:01.214+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1943 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:02.822 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:02.724+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4467 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:50:06.690 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:06.685+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1945 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:07.787 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:07.265+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:11.779 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:11.759+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4481 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:50:12.728 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:12.699+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1945 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:15.326 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:14.661+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:17.926 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:17.904+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4487 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:50:19.236 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:19.092+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1948 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:20.350 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:20.175+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:25.713 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:25.712+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4503 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:50:26.538 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:26.283+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1950 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:27.011 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:26.835+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:30.937 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:30.793+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4515 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:50:32.503 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:32.500+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1951 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:34.307 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:34.287+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:37.605 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:37.562+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1962 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:37.836 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:37.831+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4530 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:50:39.810 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:39.770+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:44.378 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:44.111+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1966 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:45.454 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:45.417+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4553 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:50:46.155 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:46.150+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:53.071 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:50:53.035+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1971 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:50:53.329 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:50:53.307+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2834 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:50:54.370 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:50:54.368+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4564 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:00.418 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:00.366+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2846 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:01.726 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:01.388+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1981 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:02.815 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:02.803+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4571 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:07.197 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:07.146+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2850 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:10.075 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:10.072+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4574 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:11.149 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:10.861+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1987 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:14.363 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:14.282+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2874 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:15.157 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:15.138+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4590 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:19.460 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:19.093+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1988 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:20.181 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:20.046+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2888 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:20.766 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:20.755+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4590 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:27.243 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:27.240+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2905 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:27.924 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:27.883+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4590 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:27.940 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:27.937+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1992 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:33.607 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:33.545+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2914 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:33.901 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:33.881+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1994 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:35.353 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:35.238+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4590 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:40.129 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:39.767+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1994 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:40.515 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:40.507+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2920 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:42.060 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:41.944+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4612 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:45.975 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:45.945+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1994 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:46.920 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:46.898+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2928 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:48.183 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:48.181+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4634 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:51.071 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:51.067+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1994 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:51:53.798 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:51:53.764+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2937 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:51:54.868 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:51:54.484+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4645 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:51:56.721 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:51:56.705+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1996 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:01.390 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:01.261+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2945 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:02.343 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:02.339+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 1996 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:02.513 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:02.510+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4656 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:07.919 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:07.915+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2008 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:08.944 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:08.942+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4675 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:09.117 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:09.100+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2955 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:15.244 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:14.190+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2008 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:15.286 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:15.268+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4683 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:15.794 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:15.178+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2962 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:19.765 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:19.373+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2026 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:22.568 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:22.364+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4687 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:22.906 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:22.754+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2976 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:25.340 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:25.212+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2028 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:29.110 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:29.105+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 2998 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:29.239 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:29.145+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4696 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:31.910 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:31.842+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2028 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:35.962 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:35.929+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3004 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:36.078 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:35.976+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4716 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:40.105 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:39.756+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2028 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:42.005 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:41.940+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3019 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:42.252 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:42.042+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4727 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:46.807 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:46.804+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2028 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:49.149 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:49.143+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3030 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:52:49.424 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:49.121+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4743 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:56.767 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:52:56.747+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2051 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:52:56.855 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:52:56.852+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4751 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:52:58.019 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:52:57.597+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3046 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:02.857 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:02.814+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3048 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:03.204 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:03.000+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4757 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:04.015 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:03.569+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2063 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:53:09.806 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:09.803+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2065 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:53:10.288 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:10.029+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:11.032 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:10.658+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4763 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:17.500 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:16.993+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2069 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:53:18.560 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:18.298+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3072 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:18.878 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:18.829+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4778 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:23.839 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:23.792+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:53:25.554 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:25.278+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:26.040 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:26.018+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3081 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:30.916 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:30.876+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:31.275 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:31.048+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3084 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:31.710 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:31.535+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:53:38.639 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:38.574+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:39.726 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:39.481+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3109 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:39.747 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:39.679+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:53:45.879 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:45.565+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:46.574 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:46.238+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:53:47.890 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:47.691+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3140 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:52.797 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:52.658+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:53:54.266 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:53:53.939+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3163 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:53:54.899 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:53:54.802+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2088 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:00.064 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:53:59.998+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:00.502 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:00.457+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3175 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:01.510 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:01.468+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2092 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:06.949 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:06.823+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4802 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:08.104 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:08.086+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2103 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:08.993 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:08.985+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3201 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:14.432 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:14.291+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:14.556 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:14.421+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3202 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:15.054 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:15.046+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2108 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:20.443 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:20.441+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:20.445 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:20.442+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3218 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:21.632 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:21.572+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2112 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:26.536 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:26.534+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:26.980 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:26.946+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3230 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:27.404 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:26.908+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2114 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:33.215 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:33.210+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:33.722 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:33.639+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3246 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:34.786 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:34.314+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2116 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:39.721 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:39.520+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:39.761 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:39.704+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2118 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:41.352 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:41.251+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3265 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:44.660 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:44.626+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:47.661 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:47.522+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2119 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:48.360 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:48.180+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3298 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:51.242 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:51.064+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:54:55.474 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:54:55.291+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2127 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:54:56.221 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:54:55.987+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3320 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:54:57.939 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:54:57.263+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:03.776 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:03.384+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3340 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:03.912 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:03.770+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:05.351 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:04.352+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2128 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:55:11.649 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:11.646+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:12.223 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:12.168+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3340 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:12.814 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:12.558+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2150 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:55:17.503 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:17.501+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3340 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:18.254 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:18.146+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2163 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:55:18.959 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:18.869+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4808 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:22.890 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:22.516+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3340 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:24.419 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:24.415+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2165 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:55:26.733 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:26.677+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4812 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:29.055 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:28.976+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3340 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:33.733 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:33.627+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4812 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:34.074 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:34.066+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2170 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:55:35.700 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:35.558+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3340 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:41.467 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:41.166+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4812 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:41.484 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:41.426+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2170 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:55:43.228 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:43.225+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3340 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:47.552 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:47.487+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4821 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:48.754 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:48.750+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:49.931 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:49.910+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2187 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:55:55.614 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:55:55.371+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4832 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:55:55.745 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:55:55.726+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:55:56.381 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:55:56.093+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:01.930 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:01.886+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:02.070 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:02.001+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4845 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:03.019 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:56:02.963+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2197 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:07.652 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:07.648+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:08.186 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:07.934+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4871 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:12.534 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:56:12.512+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2199 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:13.860 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:13.838+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:14.002 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:13.958+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4873 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:20.380 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:20.372+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:21.009 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:56:21.006+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2207 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:21.114 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:21.110+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4893 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:28.728 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:28.692+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:29.654 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:29.573+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4916 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:29.951 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:56:29.802+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2209 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:34.761 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:34.759+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3346 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:37.342 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:37.186+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4939 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:38.288 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:56:38.095+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2217 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:40.277 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:40.003+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3364 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:44.114 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:56:43.799+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2217 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:44.939 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:44.934+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4962 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:49.820 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:49.755+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3393 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:53.841 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:53.818+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4996 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:56:54.957 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:56:54.810+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2221 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:56:58.314 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:56:57.929+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:56:59.997 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:56:59.978+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 4998 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:02.841 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:02.835+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2223 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:06.858 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:06.636+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5003 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:07.925 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:07.763+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:57:08.164 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:08.159+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2231 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:13.059 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:13.037+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:57:13.948 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:13.913+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5004 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:13.986 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:13.732+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2252 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:18.761 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:18.741+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2254 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:19.183 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:18.930+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:57:20.000 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:19.952+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5016 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:27.285 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:27.244+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2254 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:27.916 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:27.914+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:57:28.667 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:28.592+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5019 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:34.025 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:33.996+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2259 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:34.499 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:34.465+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5020 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:34.920 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:34.871+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:57:40.360 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:40.034+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2259 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:40.959 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:40.716+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5038 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:41.443 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:41.300+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3401 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:57:47.779 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:47.557+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2269 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:47.872 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:47.868+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5041 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:48.018 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:48.011+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3414 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:57:54.896 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:57:54.876+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2274 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:57:55.575 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:57:55.573+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5061 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:57:55.601 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:57:55.544+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3415 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:01.226 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:01.208+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5079 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:04.099 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:04.031+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3415 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:04.446 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:04.210+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2292 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:08.957 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:08.923+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5084 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:10.147 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:10.128+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3415 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:13.339 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:12.941+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2323 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:17.053 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:16.921+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5089 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:17.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:17.075+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3415 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:20.133 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:20.129+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2335 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:23.002 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:22.866+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3415 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:24.993 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:24.825+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5104 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:28.819 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:28.477+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2339 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:33.165 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:32.895+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3437 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:33.476 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:33.159+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5106 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:33.861 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:33.812+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2339 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:39.694 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:39.614+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2339 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:40.113 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:40.092+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3458 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:41.996 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:41.762+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5106 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:44.747 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:44.689+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2339 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:45.275 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:45.202+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3480 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:50.698 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:50.680+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5106 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:51.776 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:51.772+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2339 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:58:52.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:58:52.160+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3489 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:58:58.109 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:58:58.087+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5106 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:58:59.801 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:58:59.681+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2339 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:00.952 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:00.950+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3517 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:03.998 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:03.942+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5110 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:08.477 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:08.458+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3540 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:09.864 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:09.398+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2348 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:11.258 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:11.222+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5110 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:14.662 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:14.645+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3557 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:15.386 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:15.061+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2357 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:20.236 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:20.232+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5110 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:21.905 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:21.902+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3569 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:22.452 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:22.249+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2359 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:28.571 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:28.391+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5110 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:28.857 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:28.696+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2359 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:28.903 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:28.899+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3607 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:34.753 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:34.736+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3619 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:34.973 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:34.928+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2365 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:35.089 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:34.966+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5117 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:40.500 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:40.497+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5120 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:41.480 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:41.453+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3625 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:42.049 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:41.810+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2365 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:46.423 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:46.387+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5140 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:49.065 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:48.987+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3639 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:49.735 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:49.729+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2372 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T11:59:54.497 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T11:59:54.490+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3643 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T11:59:54.515 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T11:59:54.513+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5143 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T11:59:57.807 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T11:59:57.510+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2373 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:01.757 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:01.489+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5155 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:02.507 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:02.425+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3646 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:04.835 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:04.831+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2375 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:08.403 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:08.401+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3654 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:08.431 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:08.407+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5159 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:11.178 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:10.724+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2375 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:14.944 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:14.924+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3679 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:15.113 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:15.044+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5162 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:16.955 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:16.952+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2380 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:20.674 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:20.639+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5162 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:21.673 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:21.498+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3699 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:22.783 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:22.296+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2382 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:27.610 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:27.608+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:28.010 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:27.678+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5162 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:29.034 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:28.720+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2399 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:34.736 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:34.609+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5164 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:34.839 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:34.833+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2408 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:35.665 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:35.472+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3722 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:42.909 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:42.374+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5184 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:43.605 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:43.537+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3731 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:43.872 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:43.866+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2412 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:50.344 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:50.331+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3752 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:50.532 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:50.347+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5197 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:52.241 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:52.237+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2413 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:00:55.909 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:00:55.808+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5213 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:00:57.055 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:00:57.026+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3773 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:00:58.978 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:00:58.432+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2416 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:02.746 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:02.384+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5222 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:03.494 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:03.490+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3784 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:07.360 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:07.082+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2419 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:10.529 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:10.226+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5222 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:11.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:11.192+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3806 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:14.869 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:13.668+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2420 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:15.980 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:15.915+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5222 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:18.160 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:18.050+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3821 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:18.842 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:18.675+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2420 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:22.700 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:22.665+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5222 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:23.309 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:23.275+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3829 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:24.961 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:24.958+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2421 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:28.791 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:28.620+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5222 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:28.972 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:28.869+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3851 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:31.102 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:31.089+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2427 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:34.151 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:34.102+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3861 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:37.100 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:37.017+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5222 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:39.623 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:39.615+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3868 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:40.834 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:40.289+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2427 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:42.140 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:42.035+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5222 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:46.170 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:46.129+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3870 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:46.246 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:46.009+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2428 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:47.933 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:47.928+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5223 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:51.660 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:51.456+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3876 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:01:53.984 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:01:53.886+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2434 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:01:54.370 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:01:54.363+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5249 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:01:57.491 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:01:57.322+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3885 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:01.458 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:00.866+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5251 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:02.836 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:02.628+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2438 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:05.189 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:05.146+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3900 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:08.545 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:08.110+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5252 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:10.427 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:10.269+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2440 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:12.638 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:12.451+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3910 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:14.505 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:14.438+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5277 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:18.439 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:18.383+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2441 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:18.919 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:18.841+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3911 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:20.759 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:20.756+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5293 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:25.828 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:25.812+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2441 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:26.332 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:26.262+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3920 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:27.082 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:27.078+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5314 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:33.341 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:32.930+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3934 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:33.668 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:33.664+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5316 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:34.633 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:34.510+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2447 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:38.829 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:38.826+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3941 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:40.578 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:40.575+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:42.707 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:42.702+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2447 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:44.927 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:44.906+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3945 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:47.650 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:47.530+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5326 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:48.599 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:47.889+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2451 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:51.002 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:50.984+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3962 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:02:54.089 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:02:54.073+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5335 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:02:55.930 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:02:55.828+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2451 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:02:58.960 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:02:58.668+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3981 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:01.497 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:01.240+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5346 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:03.853 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:03.841+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2454 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:04.368 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:04.215+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3991 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:07.354 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:07.080+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5351 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:09.858 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:09.638+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 3997 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:13.124 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:11.518+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2462 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:14.172 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:14.168+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5368 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:15.852 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:15.597+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4001 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:18.686 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:18.643+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2466 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:19.925 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:19.811+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5373 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:22.937 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:22.900+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4024 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:27.225 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:27.223+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5382 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:27.581 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:27.509+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2468 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:29.975 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:29.847+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4038 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:34.914 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:34.882+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2472 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:35.725 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:35.703+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4058 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:36.917 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:36.859+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5382 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:40.410 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:40.063+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2474 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:43.037 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:43.018+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5386 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:43.234 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:43.049+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:46.514 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:46.510+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2478 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:49.289 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:49.285+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4079 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:50.533 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:50.429+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5386 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:03:54.501 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:03:54.264+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2478 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:03:55.269 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:03:55.236+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4084 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:03:56.552 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:03:56.506+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5387 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:00.934 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:00.910+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4102 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:01.434 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:01.186+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2478 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:04.046 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:04.042+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5387 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:08.582 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:08.396+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4118 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:08.623 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:08.101+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2479 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:11.445 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:11.035+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:13.924 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:13.843+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2479 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:15.860 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:15.674+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4126 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:19.127 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:18.749+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:19.514 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:19.181+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2479 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:22.893 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:22.819+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4137 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:24.075 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:24.038+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:26.054 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:25.925+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2481 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:29.469 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:29.440+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4148 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:29.927 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:29.817+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:33.978 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:33.612+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2481 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:35.687 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:35.683+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4158 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:36.086 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:35.975+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:39.636 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:39.630+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2481 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:43.444 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:43.438+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:43.553 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:43.511+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4177 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:45.737 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:45.734+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2482 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:47.775 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:04:47.771+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:47.772401+0000) 2021-08-03T12:04:47.969 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:47.968+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:47.969522+0000) 2021-08-03T12:04:48.351 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:48.348+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:48.349509+0000) 2021-08-03T12:04:48.530 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:04:48.527+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:48.527656+0000) 2021-08-03T12:04:48.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:48.566+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:48.567196+0000) 2021-08-03T12:04:48.775 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:04:48.773+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:48.774636+0000) 2021-08-03T12:04:48.970 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:48.968+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:48.969666+0000) 2021-08-03T12:04:49.117 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:04:49.112+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:49.112836+0000) 2021-08-03T12:04:49.351 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:49.348+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:49.349672+0000) 2021-08-03T12:04:49.532 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:04:49.529+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:49.529964+0000) 2021-08-03T12:04:49.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:49.566+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:49.567389+0000) 2021-08-03T12:04:49.776 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:04:49.774+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:49.775443+0000) 2021-08-03T12:04:49.970 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:49.968+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:49.969818+0000) 2021-08-03T12:04:50.351 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:50.349+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:50.349831+0000) 2021-08-03T12:04:50.532 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:04:50.529+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:50.530671+0000) 2021-08-03T12:04:50.674 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:50.671+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4185 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:50.759 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:50.758+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:50.759354+0000) 2021-08-03T12:04:50.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:50.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:50.774802+0000) 2021-08-03T12:04:50.777 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:04:50.775+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:50.776135+0000) 2021-08-03T12:04:50.925 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:50.163+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5389 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:50.970 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:50.969+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:50.969929+0000) 2021-08-03T12:04:51.003 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:51.001+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:51.001985+0000) 2021-08-03T12:04:51.351 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:51.349+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:51.349955+0000) 2021-08-03T12:04:51.355 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:04:51.351+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:51.352171+0000) 2021-08-03T12:04:51.532 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:04:51.530+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:51.531298+0000) 2021-08-03T12:04:51.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:51.774+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:51.774970+0000) 2021-08-03T12:04:51.777 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:04:51.775+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:51.776694+0000) 2021-08-03T12:04:51.970 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:51.969+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:51.970057+0000) 2021-08-03T12:04:52.222 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:52.220+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:52.221110+0000) 2021-08-03T12:04:52.351 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:52.349+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:52.350098+0000) 2021-08-03T12:04:52.468 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:04:52.463+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:52.464313+0000) 2021-08-03T12:04:52.533 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:04:52.531+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:52.531853+0000) 2021-08-03T12:04:52.779 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:04:52.776+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:52.777594+0000) 2021-08-03T12:04:52.849 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:04:52.551+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2491 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:04:52.970 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:52.969+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:52.970189+0000) 2021-08-03T12:04:53.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:53.222+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:53.223670+0000) 2021-08-03T12:04:53.970 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:53.969+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:53.970335+0000) 2021-08-03T12:04:54.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:54.223+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:54.223843+0000) 2021-08-03T12:04:54.388 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:04:54.383+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:54.383741+0000) 2021-08-03T12:04:54.759 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:54.757+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:54.757982+0000) 2021-08-03T12:04:54.971 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:54.969+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:54.970473+0000) 2021-08-03T12:04:55.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:55.223+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:55.223950+0000) 2021-08-03T12:04:55.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:55.224+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:55.224999+0000) 2021-08-03T12:04:55.486 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:04:55.483+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:55.484304+0000) 2021-08-03T12:04:55.971 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:55.969+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:55.970617+0000) 2021-08-03T12:04:56.059 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:04:56.054+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:56.055037+0000) 2021-08-03T12:04:56.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:56.223+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:56.224186+0000) 2021-08-03T12:04:56.971 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:56.969+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:56.970774+0000) 2021-08-03T12:04:57.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:57.223+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:57.224337+0000) 2021-08-03T12:04:57.971 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:57.970+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:57.970925+0000) 2021-08-03T12:04:58.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:58.223+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:58.224497+0000) 2021-08-03T12:04:58.530 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:04:58.254+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4198 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:04:58.558 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:04:58.517+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5406 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:04:58.581 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:04:58.576+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:58.576711+0000) 2021-08-03T12:04:58.973 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:58.970+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:58.971069+0000) 2021-08-03T12:04:59.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:04:59.223+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:59.224649+0000) 2021-08-03T12:04:59.649 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:04:59.644+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:59.643981+0000) 2021-08-03T12:04:59.971 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:04:59.970+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:04:59.971206+0000) 2021-08-03T12:05:00.017 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:00.015+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.016564+0000) 2021-08-03T12:05:00.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:00.224+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.224838+0000) 2021-08-03T12:05:00.448 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:00.126+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2505 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:00.449 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:00.445+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.445851+0000) 2021-08-03T12:05:00.460 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:00.456+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.457738+0000) 2021-08-03T12:05:00.497 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:00.493+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.493788+0000) 2021-08-03T12:05:00.650 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:00.647+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.647971+0000) 2021-08-03T12:05:00.793 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:00.790+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.791114+0000) 2021-08-03T12:05:00.793 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:00.789+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.789928+0000) 2021-08-03T12:05:00.971 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:00.970+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:00.971337+0000) 2021-08-03T12:05:01.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:01.224+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:01.224956+0000) 2021-08-03T12:05:01.582 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:01.580+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:01.581429+0000) 2021-08-03T12:05:01.650 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:01.647+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:01.648607+0000) 2021-08-03T12:05:01.708 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:01.705+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:01.706049+0000) 2021-08-03T12:05:01.793 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:01.791+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:01.791885+0000) 2021-08-03T12:05:02.651 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:02.648+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:02.649190+0000) 2021-08-03T12:05:02.793 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:02.791+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:02.792693+0000) 2021-08-03T12:05:03.652 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:03.649+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:03.650072+0000) 2021-08-03T12:05:03.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:03.721+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:03.722202+0000) 2021-08-03T12:05:03.794 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:03.792+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:03.793383+0000) 2021-08-03T12:05:04.490 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:03.976+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4212 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:04.653 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:04.649+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:04.650704+0000) 2021-08-03T12:05:04.795 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:04.793+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:04.793934+0000) 2021-08-03T12:05:04.937 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:04.936+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:04.937511+0000) 2021-08-03T12:05:05.653 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:05.650+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:05.651344+0000) 2021-08-03T12:05:05.910 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:05.776+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5430 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:06.319 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:06.317+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:06.318655+0000) 2021-08-03T12:05:06.324 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:06.255+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2505 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:06.326 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:06.323+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:06.323833+0000) 2021-08-03T12:05:06.653 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:06.651+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:06.651899+0000) 2021-08-03T12:05:06.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:06.774+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:06.775398+0000) 2021-08-03T12:05:06.871 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:06.868+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:06.869550+0000) 2021-08-03T12:05:07.029 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:07.026+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:07.026921+0000) 2021-08-03T12:05:07.654 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:07.651+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:07.652478+0000) 2021-08-03T12:05:07.871 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:07.869+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:07.870501+0000) 2021-08-03T12:05:08.029 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:08.026+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:08.027635+0000) 2021-08-03T12:05:08.517 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:08.513+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:08.514508+0000) 2021-08-03T12:05:08.655 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:08.652+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:08.653293+0000) 2021-08-03T12:05:08.872 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:08.870+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:08.871142+0000) 2021-08-03T12:05:08.976 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:08.974+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:08.975476+0000) 2021-08-03T12:05:09.030 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:09.027+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:09.028228+0000) 2021-08-03T12:05:09.159 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:08.987+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4237 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:09.366 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:09.364+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:09.365632+0000) 2021-08-03T12:05:09.367 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:09.364+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:09.365616+0000) 2021-08-03T12:05:09.520 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:09.514+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:09.515554+0000) 2021-08-03T12:05:09.656 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:09.653+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:09.653902+0000) 2021-08-03T12:05:09.872 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:09.870+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:09.871744+0000) 2021-08-03T12:05:10.030 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:10.028+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:10.028826+0000) 2021-08-03T12:05:10.526 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:10.524+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:10.525077+0000) 2021-08-03T12:05:10.656 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:10.653+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:10.654603+0000) 2021-08-03T12:05:10.873 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:10.871+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:10.872352+0000) 2021-08-03T12:05:11.031 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:11.028+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:11.029409+0000) 2021-08-03T12:05:11.659 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:11.654+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:11.655367+0000) 2021-08-03T12:05:11.811 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:11.808+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:11.809431+0000) 2021-08-03T12:05:11.874 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:11.872+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:11.872985+0000) 2021-08-03T12:05:12.032 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:12.029+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:12.029931+0000) 2021-08-03T12:05:12.225 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:12.092+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5447 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:12.658 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:12.655+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:12.655936+0000) 2021-08-03T12:05:12.836 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:12.834+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:12.834949+0000) 2021-08-03T12:05:12.874 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:12.872+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:12.873588+0000) 2021-08-03T12:05:13.032 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:13.029+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:13.030471+0000) 2021-08-03T12:05:13.110 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:13.106+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:13.107172+0000) 2021-08-03T12:05:13.658 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:13.655+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:13.656538+0000) 2021-08-03T12:05:13.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:13.657+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:13.658476+0000) 2021-08-03T12:05:13.686 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:13.684+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:13.685603+0000) 2021-08-03T12:05:13.785 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:13.782+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:13.783737+0000) 2021-08-03T12:05:13.875 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:13.873+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:13.874401+0000) 2021-08-03T12:05:14.033 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:14.030+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:14.031020+0000) 2021-08-03T12:05:14.237 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:14.035+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4243 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:14.659 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:14.656+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:14.657093+0000) 2021-08-03T12:05:14.687 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:14.685+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:14.686157+0000) 2021-08-03T12:05:14.786 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:14.783+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:14.784739+0000) 2021-08-03T12:05:14.876 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:14.874+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:14.875680+0000) 2021-08-03T12:05:15.033 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:15.030+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:15.031666+0000) 2021-08-03T12:05:15.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:15.411+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:15.412594+0000) 2021-08-03T12:05:15.660 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:15.657+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:15.658462+0000) 2021-08-03T12:05:15.741 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:15.686+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:15.687232+0000) 2021-08-03T12:05:15.741 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:15.328+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2505 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:15.786 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:15.784+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:15.785317+0000) 2021-08-03T12:05:15.878 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:15.876+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:15.876863+0000) 2021-08-03T12:05:16.034 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:16.031+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.032255+0000) 2021-08-03T12:05:16.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:16.271+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.272494+0000) 2021-08-03T12:05:16.419 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:16.416+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.417569+0000) 2021-08-03T12:05:16.661 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:16.658+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.659532+0000) 2021-08-03T12:05:16.689 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:16.687+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.688186+0000) 2021-08-03T12:05:16.731 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:16.728+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.729635+0000) 2021-08-03T12:05:16.787 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:16.785+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.785903+0000) 2021-08-03T12:05:16.879 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:16.877+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:16.878039+0000) 2021-08-03T12:05:17.034 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:17.032+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.032857+0000) 2021-08-03T12:05:17.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:17.404+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.405597+0000) 2021-08-03T12:05:17.423 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:17.420+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.419764+0000) 2021-08-03T12:05:17.489 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:17.486+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.487267+0000) 2021-08-03T12:05:17.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:17.567+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.567861+0000) 2021-08-03T12:05:17.662 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:17.659+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.660505+0000) 2021-08-03T12:05:17.690 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:17.688+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.689168+0000) 2021-08-03T12:05:17.733 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:17.731+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.731913+0000) 2021-08-03T12:05:17.787 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:17.785+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.786727+0000) 2021-08-03T12:05:17.880 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:17.878+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:17.879097+0000) 2021-08-03T12:05:18.035 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:18.032+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:18.033709+0000) 2021-08-03T12:05:18.425 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:18.422+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:18.423159+0000) 2021-08-03T12:05:18.663 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:18.660+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:18.661430+0000) 2021-08-03T12:05:18.691 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:18.689+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:18.690153+0000) 2021-08-03T12:05:18.733 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:18.731+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:18.732130+0000) 2021-08-03T12:05:18.788 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:18.786+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:18.787288+0000) 2021-08-03T12:05:18.871 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:18.720+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5458 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:18.881 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:18.879+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:18.880110+0000) 2021-08-03T12:05:19.036 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:19.033+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:19.034258+0000) 2021-08-03T12:05:19.109 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:19.087+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4245 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:19.426 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:19.423+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:19.424124+0000) 2021-08-03T12:05:19.665 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:19.661+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:19.662398+0000) 2021-08-03T12:05:19.788 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:19.787+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:19.787857+0000) 2021-08-03T12:05:19.882 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:19.880+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:19.881030+0000) 2021-08-03T12:05:19.912 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:19.910+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:19.911441+0000) 2021-08-03T12:05:20.037 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:20.034+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.035036+0000) 2021-08-03T12:05:20.124 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:20.122+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.123558+0000) 2021-08-03T12:05:20.248 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:20.244+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.245574+0000) 2021-08-03T12:05:20.427 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:20.424+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.425252+0000) 2021-08-03T12:05:20.666 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:20.662+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.663474+0000) 2021-08-03T12:05:20.790 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:20.787+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.788435+0000) 2021-08-03T12:05:20.883 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:20.881+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.881944+0000) 2021-08-03T12:05:20.892 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:20.890+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:20.891291+0000) 2021-08-03T12:05:21.037 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:21.033+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:21.035630+0000) 2021-08-03T12:05:21.428 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:21.424+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:21.426369+0000) 2021-08-03T12:05:21.667 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:21.663+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:21.665040+0000) 2021-08-03T12:05:21.790 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:21.788+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:21.789416+0000) 2021-08-03T12:05:21.884 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:21.882+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:21.883004+0000) 2021-08-03T12:05:21.886 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:21.883+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:21.885733+0000) 2021-08-03T12:05:21.972 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:21.970+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:21.971761+0000) 2021-08-03T12:05:22.038 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:22.034+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:22.036194+0000) 2021-08-03T12:05:22.222 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:22.219+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:22.221316+0000) 2021-08-03T12:05:22.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:22.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:22.775290+0000) 2021-08-03T12:05:22.842 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:22.838+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:22.839613+0000) 2021-08-03T12:05:22.972 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:22.971+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:22.971910+0000) 2021-08-03T12:05:23.136 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:23.132+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2507 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:23.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:23.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:23.775452+0000) 2021-08-03T12:05:23.972 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:23.971+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:23.972031+0000) 2021-08-03T12:05:24.048 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:24.043+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:24.044535+0000) 2021-08-03T12:05:24.052 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:24.032+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5472 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:24.239 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:24.234+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:24.236383+0000) 2021-08-03T12:05:24.453 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:24.449+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:24.451004+0000) 2021-08-03T12:05:24.494 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:24.489+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:24.491558+0000) 2021-08-03T12:05:24.519 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:24.490+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4254 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:24.546 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:24.543+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:24.543819+0000) 2021-08-03T12:05:24.972 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:24.971+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:24.972159+0000) 2021-08-03T12:05:25.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:25.069+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:25.071509+0000) 2021-08-03T12:05:25.712 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:25.708+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:25.709661+0000) 2021-08-03T12:05:25.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:25.814+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:25.816529+0000) 2021-08-03T12:05:25.851 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:25.847+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:25.849767+0000) 2021-08-03T12:05:25.972 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:25.971+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:25.972304+0000) 2021-08-03T12:05:26.685 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:26.682+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:26.684071+0000) 2021-08-03T12:05:27.127 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:27.122+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:27.123927+0000) 2021-08-03T12:05:27.685 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:27.682+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:27.684209+0000) 2021-08-03T12:05:28.685 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:28.682+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:28.684369+0000) 2021-08-03T12:05:29.130 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:29.128+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:29.129698+0000) 2021-08-03T12:05:29.322 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:29.319+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:29.321550+0000) 2021-08-03T12:05:29.685 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:29.683+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:29.684506+0000) 2021-08-03T12:05:29.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:29.855+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:29.857628+0000) 2021-08-03T12:05:30.686 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:30.683+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:30.684648+0000) 2021-08-03T12:05:30.686 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:30.378+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5472 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:30.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:30.859+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:30.859992+0000) 2021-08-03T12:05:30.883 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:30.880+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:30.880810+0000) 2021-08-03T12:05:31.542 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:30.950+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4264 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:31.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:31.736+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:31.737039+0000) 2021-08-03T12:05:31.779 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:31.777+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:31.778268+0000) 2021-08-03T12:05:31.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:31.859+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:31.860136+0000) 2021-08-03T12:05:32.332 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:32.026+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2510 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:32.779 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:32.778+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:32.779003+0000) 2021-08-03T12:05:32.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:32.859+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:32.860308+0000) 2021-08-03T12:05:33.303 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:33.301+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:33.301777+0000) 2021-08-03T12:05:33.781 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:33.779+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:33.779982+0000) 2021-08-03T12:05:33.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:33.859+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:33.860454+0000) 2021-08-03T12:05:34.304 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:34.301+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:34.302519+0000) 2021-08-03T12:05:34.782 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:34.780+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:34.780813+0000) 2021-08-03T12:05:34.862 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:34.859+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:34.860644+0000) 2021-08-03T12:05:35.305 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:35.302+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:35.303327+0000) 2021-08-03T12:05:35.640 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:35.636+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:35.637297+0000) 2021-08-03T12:05:35.782 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:35.780+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:35.781415+0000) 2021-08-03T12:05:35.799 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:35.796+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:35.797455+0000) 2021-08-03T12:05:35.862 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:35.860+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:35.860821+0000) 2021-08-03T12:05:36.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:36.253+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:36.254128+0000) 2021-08-03T12:05:36.305 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:36.303+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:36.303938+0000) 2021-08-03T12:05:36.783 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:36.781+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:36.781975+0000) 2021-08-03T12:05:36.799 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:36.797+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:36.798462+0000) 2021-08-03T12:05:36.862 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:36.860+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:36.861017+0000) 2021-08-03T12:05:37.014 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:37.011+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:37.012596+0000) 2021-08-03T12:05:37.038 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:37.033+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:37.034187+0000) 2021-08-03T12:05:37.307 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:37.303+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:37.304518+0000) 2021-08-03T12:05:37.784 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:37.780+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:37.782606+0000) 2021-08-03T12:05:37.799 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:37.797+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:37.799061+0000) 2021-08-03T12:05:37.862 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:37.860+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:37.861138+0000) 2021-08-03T12:05:37.925 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:37.890+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5477 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:37.931 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:37.927+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:37.928079+0000) 2021-08-03T12:05:38.307 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:38.304+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:38.305356+0000) 2021-08-03T12:05:38.764 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:38.545+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4290 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:38.784 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:38.781+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:38.783515+0000) 2021-08-03T12:05:38.800 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:38.797+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:38.799661+0000) 2021-08-03T12:05:38.812 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:38.794+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2510 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:39.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:39.183+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:39.183916+0000) 2021-08-03T12:05:39.307 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:39.305+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:39.305967+0000) 2021-08-03T12:05:39.785 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:39.782+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:39.784503+0000) 2021-08-03T12:05:39.801 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:39.798+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:39.800523+0000) 2021-08-03T12:05:40.129 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:40.126+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:40.127036+0000) 2021-08-03T12:05:40.308 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:40.305+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:40.306558+0000) 2021-08-03T12:05:40.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:40.567+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:40.567986+0000) 2021-08-03T12:05:40.786 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:40.783+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:40.785488+0000) 2021-08-03T12:05:40.802 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:40.799+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:40.801103+0000) 2021-08-03T12:05:40.899 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:40.890+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:40.892354+0000) 2021-08-03T12:05:41.309 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:41.306+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:41.307484+0000) 2021-08-03T12:05:41.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:41.567+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:41.568101+0000) 2021-08-03T12:05:41.787 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:41.784+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:41.786114+0000) 2021-08-03T12:05:42.285 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:42.282+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:42.282945+0000) 2021-08-03T12:05:42.310 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:42.307+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:42.308064+0000) 2021-08-03T12:05:42.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:42.567+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:42.568281+0000) 2021-08-03T12:05:42.788 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:42.785+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:42.787452+0000) 2021-08-03T12:05:42.796 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:42.793+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:42.795094+0000) 2021-08-03T12:05:43.043 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:43.038+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:43.039626+0000) 2021-08-03T12:05:43.310 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:43.307+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:43.308685+0000) 2021-08-03T12:05:43.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:43.567+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:43.568435+0000) 2021-08-03T12:05:43.792 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:43.786+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:43.788663+0000) 2021-08-03T12:05:43.797 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:43.794+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:43.795824+0000) 2021-08-03T12:05:43.954 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:43.952+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:43.953508+0000) 2021-08-03T12:05:44.042 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:44.039+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:44.040662+0000) 2021-08-03T12:05:44.311 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:44.308+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:44.309423+0000) 2021-08-03T12:05:44.504 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:44.175+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5481 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:44.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:44.567+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:44.568577+0000) 2021-08-03T12:05:44.725 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:44.722+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:44.724856+0000) 2021-08-03T12:05:44.790 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:44.787+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:44.789421+0000) 2021-08-03T12:05:44.797 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:44.794+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:44.796657+0000) 2021-08-03T12:05:45.019 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:44.975+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2515 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:45.043 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:45.040+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:45.041290+0000) 2021-08-03T12:05:45.312 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:45.309+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:45.310050+0000) 2021-08-03T12:05:45.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:45.567+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:45.568744+0000) 2021-08-03T12:05:45.791 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:45.789+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:45.790004+0000) 2021-08-03T12:05:45.798 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:45.796+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:45.797488+0000) 2021-08-03T12:05:46.033 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:46.031+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.032328+0000) 2021-08-03T12:05:46.044 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:46.041+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.041896+0000) 2021-08-03T12:05:46.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:46.199+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.200498+0000) 2021-08-03T12:05:46.312 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:46.309+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.310647+0000) 2021-08-03T12:05:46.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:46.568+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.568903+0000) 2021-08-03T12:05:46.791 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:46.789+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.790606+0000) 2021-08-03T12:05:46.799 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:46.797+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.798082+0000) 2021-08-03T12:05:46.973 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:46.971+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:46.972868+0000) 2021-08-03T12:05:47.045 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:47.042+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.042756+0000) 2021-08-03T12:05:47.310 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:47.275+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4320 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:47.313 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:47.310+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.311232+0000) 2021-08-03T12:05:47.543 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:47.541+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.541979+0000) 2021-08-03T12:05:47.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:47.568+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.569041+0000) 2021-08-03T12:05:47.792 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:47.790+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.791177+0000) 2021-08-03T12:05:47.800 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:47.798+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.798803+0000) 2021-08-03T12:05:47.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:47.819+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.819918+0000) 2021-08-03T12:05:47.973 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:47.972+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:47.973017+0000) 2021-08-03T12:05:48.314 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:48.311+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:48.311854+0000) 2021-08-03T12:05:48.793 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:48.791+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:48.791867+0000) 2021-08-03T12:05:48.801 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:48.799+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:48.799987+0000) 2021-08-03T12:05:48.973 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:48.972+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:48.973158+0000) 2021-08-03T12:05:48.988 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:48.985+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:48.986580+0000) 2021-08-03T12:05:49.315 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:49.311+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:49.312704+0000) 2021-08-03T12:05:49.696 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:49.692+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:49.693534+0000) 2021-08-03T12:05:49.794 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:49.791+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:49.792694+0000) 2021-08-03T12:05:49.801 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:49.800+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:49.800793+0000) 2021-08-03T12:05:49.969 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:05:49.965+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:49.966227+0000) 2021-08-03T12:05:49.973 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:49.972+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:49.973333+0000) 2021-08-03T12:05:49.991 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:49.989+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:49.990146+0000) 2021-08-03T12:05:50.315 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:50.312+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:50.313340+0000) 2021-08-03T12:05:50.708 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:50.704+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:50.705537+0000) 2021-08-03T12:05:50.794 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:50.792+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:50.793330+0000) 2021-08-03T12:05:50.803 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:50.800+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:50.801411+0000) 2021-08-03T12:05:50.922 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:50.920+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:50.921445+0000) 2021-08-03T12:05:50.973 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:50.972+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:50.973497+0000) 2021-08-03T12:05:50.991 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:50.989+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:50.990370+0000) 2021-08-03T12:05:51.076 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:50.750+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5487 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:51.315 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:51.313+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:51.313926+0000) 2021-08-03T12:05:51.686 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:51.684+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:51.685083+0000) 2021-08-03T12:05:51.795 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:51.793+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:51.793946+0000) 2021-08-03T12:05:51.803 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:51.801+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:51.802207+0000) 2021-08-03T12:05:51.974 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:51.972+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:51.973632+0000) 2021-08-03T12:05:51.991 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:51.989+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:51.990549+0000) 2021-08-03T12:05:52.316 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:52.313+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:52.314510+0000) 2021-08-03T12:05:52.686 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:52.684+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:52.685212+0000) 2021-08-03T12:05:52.795 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:52.793+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:52.794715+0000) 2021-08-03T12:05:52.804 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:52.802+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:52.802800+0000) 2021-08-03T12:05:52.974 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:52.972+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:52.973795+0000) 2021-08-03T12:05:52.992 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:52.989+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:52.990659+0000) 2021-08-03T12:05:52.995 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:05:52.991+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:52.992443+0000) 2021-08-03T12:05:53.039 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:05:52.987+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4335 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:05:53.316 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:05:53.313+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:53.314410+0000) 2021-08-03T12:05:53.317 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:53.314+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:53.315201+0000) 2021-08-03T12:05:53.686 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:53.684+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:53.685359+0000) 2021-08-03T12:05:53.796 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:53.794+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:53.795360+0000) 2021-08-03T12:05:53.974 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:05:53.973+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:53.973952+0000) 2021-08-03T12:05:53.992 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:53.990+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:53.990870+0000) 2021-08-03T12:05:54.318 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:54.315+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:54.315947+0000) 2021-08-03T12:05:54.686 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:54.684+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:54.685508+0000) 2021-08-03T12:05:54.797 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:54.795+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:54.796164+0000) 2021-08-03T12:05:55.068 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:05:54.785+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2519 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:05:55.318 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:55.315+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:55.316561+0000) 2021-08-03T12:05:55.385 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:55.381+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:55.382354+0000) 2021-08-03T12:05:55.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:55.684+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:55.685665+0000) 2021-08-03T12:05:55.797 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:55.795+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:55.796784+0000) 2021-08-03T12:05:56.050 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:05:56.047+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:56.047836+0000) 2021-08-03T12:05:56.319 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:56.316+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:56.317383+0000) 2021-08-03T12:05:56.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:56.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:56.685818+0000) 2021-08-03T12:05:56.798 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:56.796+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:56.797429+0000) 2021-08-03T12:05:56.908 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:05:56.861+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5501 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:05:57.320 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:57.317+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:57.317966+0000) 2021-08-03T12:05:57.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:57.570+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:57.571318+0000) 2021-08-03T12:05:57.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:57.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:57.685947+0000) 2021-08-03T12:05:57.799 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:57.797+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:57.798262+0000) 2021-08-03T12:05:58.320 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:58.317+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:58.318563+0000) 2021-08-03T12:05:58.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:58.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:58.686075+0000) 2021-08-03T12:05:58.800 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:58.798+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:58.799110+0000) 2021-08-03T12:05:59.291 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:05:59.287+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:59.287889+0000) 2021-08-03T12:05:59.321 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:05:59.318+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:59.319408+0000) 2021-08-03T12:05:59.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:05:59.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:59.686250+0000) 2021-08-03T12:05:59.800 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:05:59.798+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:59.799740+0000) 2021-08-03T12:05:59.866 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:05:59.863+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:05:59.863868+0000) 2021-08-03T12:06:00.105 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:00.033+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2519 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:00.322 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:00.319+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:00.320008+0000) 2021-08-03T12:06:00.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:00.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:00.686374+0000) 2021-08-03T12:06:00.774 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:06:00.771+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:00.772358+0000) 2021-08-03T12:06:00.801 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:00.799+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:00.800733+0000) 2021-08-03T12:06:00.956 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:00.846+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4348 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:01.322 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:01.319+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:01.320585+0000) 2021-08-03T12:06:01.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:01.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:01.686490+0000) 2021-08-03T12:06:02.003 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:02.000+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:02.000939+0000) 2021-08-03T12:06:02.323 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:02.320+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:02.321322+0000) 2021-08-03T12:06:02.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:02.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:02.686641+0000) 2021-08-03T12:06:02.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:02.784+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:02.785508+0000) 2021-08-03T12:06:02.922 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:06:02.919+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:02.919811+0000) 2021-08-03T12:06:03.174 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:03.172+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:03.173580+0000) 2021-08-03T12:06:03.328 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:03.321+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:03.322159+0000) 2021-08-03T12:06:03.346 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:03.342+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:03.343634+0000) 2021-08-03T12:06:03.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:03.685+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:03.686741+0000) 2021-08-03T12:06:03.961 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:03.926+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5505 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:03.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:03.961+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:03.962279+0000) 2021-08-03T12:06:04.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:04.686+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:04.686883+0000) 2021-08-03T12:06:05.117 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:05.115+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:05.116287+0000) 2021-08-03T12:06:05.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:05.686+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:05.687009+0000) 2021-08-03T12:06:06.121 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:06.118+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:06.119738+0000) 2021-08-03T12:06:06.141 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:06.139+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:06.139795+0000) 2021-08-03T12:06:06.281 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:06.279+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:06.280171+0000) 2021-08-03T12:06:06.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:06.686+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:06.687171+0000) 2021-08-03T12:06:07.141 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:07.139+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:07.140517+0000) 2021-08-03T12:06:07.405 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:07.401+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:07.402029+0000) 2021-08-03T12:06:07.423 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:07.420+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:07.421126+0000) 2021-08-03T12:06:07.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:07.686+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:07.687299+0000) 2021-08-03T12:06:07.927 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:07.926+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:07.927248+0000) 2021-08-03T12:06:08.048 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:08.045+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:08.046097+0000) 2021-08-03T12:06:08.142 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:08.140+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:08.141500+0000) 2021-08-03T12:06:08.199 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:07.673+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2521 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:08.559 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:08.557+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:08.558065+0000) 2021-08-03T12:06:08.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:08.686+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:08.687492+0000) 2021-08-03T12:06:08.691 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:08.689+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:08.690023+0000) 2021-08-03T12:06:09.049 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:09.046+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:09.046806+0000) 2021-08-03T12:06:09.143 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:09.141+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:09.142433+0000) 2021-08-03T12:06:09.284 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:08.993+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4370 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:09.560 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:09.558+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:09.558779+0000) 2021-08-03T12:06:09.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:09.686+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:09.687645+0000) 2021-08-03T12:06:10.049 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:10.046+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:10.047650+0000) 2021-08-03T12:06:10.078 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:10.075+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:10.076431+0000) 2021-08-03T12:06:10.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:10.413+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:10.415730+0000) 2021-08-03T12:06:10.560 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:10.558+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:10.559522+0000) 2021-08-03T12:06:10.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:10.686+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:10.687833+0000) 2021-08-03T12:06:11.025 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:11.022+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:11.023299+0000) 2021-08-03T12:06:11.050 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:11.046+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:11.048203+0000) 2021-08-03T12:06:11.079 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:11.075+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:11.077046+0000) 2021-08-03T12:06:11.428 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:11.242+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5505 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:11.561 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:11.559+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:11.560142+0000) 2021-08-03T12:06:11.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:11.610+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:11.611910+0000) 2021-08-03T12:06:11.809 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:11.807+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:11.808438+0000) 2021-08-03T12:06:12.051 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:12.047+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:12.048926+0000) 2021-08-03T12:06:12.079 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:12.075+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:12.077691+0000) 2021-08-03T12:06:12.555 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:06:12.550+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:12.552154+0000) 2021-08-03T12:06:12.561 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:12.559+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:12.560772+0000) 2021-08-03T12:06:12.810 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:12.808+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:12.809002+0000) 2021-08-03T12:06:13.051 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:13.047+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.049516+0000) 2021-08-03T12:06:13.080 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:13.076+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.078270+0000) 2021-08-03T12:06:13.333 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:13.329+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.330721+0000) 2021-08-03T12:06:13.407 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:13.404+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.404996+0000) 2021-08-03T12:06:13.562 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:13.560+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.561340+0000) 2021-08-03T12:06:13.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:13.585+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.586859+0000) 2021-08-03T12:06:13.705 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:06:13.700+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.702447+0000) 2021-08-03T12:06:13.811 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:13.808+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:13.809606+0000) 2021-08-03T12:06:14.052 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:14.048+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:14.050127+0000) 2021-08-03T12:06:14.081 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:14.077+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:14.078903+0000) 2021-08-03T12:06:14.563 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:14.561+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:14.561911+0000) 2021-08-03T12:06:14.811 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:14.809+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:14.810441+0000) 2021-08-03T12:06:14.974 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:14.973+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:14.974260+0000) 2021-08-03T12:06:15.052 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:15.048+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:15.050704+0000) 2021-08-03T12:06:15.081 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:15.077+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:15.079625+0000) 2021-08-03T12:06:15.564 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:15.561+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:15.562509+0000) 2021-08-03T12:06:15.812 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:15.810+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:15.811012+0000) 2021-08-03T12:06:15.974 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:15.973+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:15.974430+0000) 2021-08-03T12:06:16.053 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:16.049+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:16.051680+0000) 2021-08-03T12:06:16.082 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:16.078+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:16.080203+0000) 2021-08-03T12:06:16.564 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:16.562+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:16.563120+0000) 2021-08-03T12:06:16.808 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:16.374+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2521 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:16.812 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:16.811+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:16.811816+0000) 2021-08-03T12:06:16.975 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:16.973+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:16.974556+0000) 2021-08-03T12:06:17.054 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:17.050+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:17.052282+0000) 2021-08-03T12:06:17.083 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:17.079+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:17.080798+0000) 2021-08-03T12:06:17.246 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:17.243+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:17.245268+0000) 2021-08-03T12:06:17.565 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:17.562+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:17.563702+0000) 2021-08-03T12:06:17.782 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:17.621+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4387 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:19.096 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:19.093+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:19.095227+0000) 2021-08-03T12:06:19.346 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:19.344+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:19.345175+0000) 2021-08-03T12:06:19.666 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:19.642+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5506 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:19.852 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:19.851+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:19.852008+0000) 2021-08-03T12:06:19.854 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:19.852+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:19.853102+0000) 2021-08-03T12:06:20.253 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:20.251+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:20.251877+0000) 2021-08-03T12:06:21.067 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:21.064+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:21.065192+0000) 2021-08-03T12:06:21.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:21.147+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:21.147939+0000) 2021-08-03T12:06:21.597 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:21.594+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:21.595108+0000) 2021-08-03T12:06:21.839 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:21.835+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:21.836363+0000) 2021-08-03T12:06:22.138 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:22.135+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:22.136693+0000) 2021-08-03T12:06:22.521 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:06:22.517+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:22.518342+0000) 2021-08-03T12:06:23.400 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:23.397+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:23.398438+0000) 2021-08-03T12:06:23.481 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:23.479+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:23.479996+0000) 2021-08-03T12:06:24.044 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:24.026+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2531 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:24.230 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:24.205+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4399 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:24.239 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:06:24.233+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:24.234328+0000) 2021-08-03T12:06:24.950 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:24.949+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:24.950110+0000) 2021-08-03T12:06:25.778 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:25.697+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5506 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:25.808 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:25.806+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:25.806933+0000) 2021-08-03T12:06:25.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:25.813+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:25.814353+0000) 2021-08-03T12:06:27.221 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:27.219+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:27.220375+0000) 2021-08-03T12:06:27.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:27.471+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:27.472611+0000) 2021-08-03T12:06:27.541 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:27.537+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:27.538396+0000) 2021-08-03T12:06:27.916 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:27.912+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:27.913482+0000) 2021-08-03T12:06:28.374 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:28.372+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:28.373160+0000) 2021-08-03T12:06:29.217 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:06:29.213+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:29.214545+0000) 2021-08-03T12:06:29.377 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:29.375+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:29.375824+0000) 2021-08-03T12:06:29.645 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:29.644+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:29.645052+0000) 2021-08-03T12:06:30.259 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:30.256+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:30.257606+0000) 2021-08-03T12:06:30.377 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:30.375+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:30.376058+0000) 2021-08-03T12:06:30.540 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:30.535+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:30.536505+0000) 2021-08-03T12:06:31.096 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:30.535+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2531 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:31.377 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:31.375+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:31.376208+0000) 2021-08-03T12:06:31.641 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:31.639+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5508 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:32.377 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:32.375+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:32.376408+0000) 2021-08-03T12:06:33.070 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:33.046+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4407 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:34.561 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:34.557+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:34.558172+0000) 2021-08-03T12:06:34.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:34.707+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:34.707997+0000) 2021-08-03T12:06:34.966 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:34.963+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:34.964527+0000) 2021-08-03T12:06:35.857 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:35.854+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:35.855340+0000) 2021-08-03T12:06:35.967 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:35.964+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:35.965250+0000) 2021-08-03T12:06:36.495 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:36.493+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:36.494488+0000) 2021-08-03T12:06:36.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:36.830+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:36.831431+0000) 2021-08-03T12:06:36.967 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:36.965+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:36.965852+0000) 2021-08-03T12:06:37.105 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:37.103+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:37.104097+0000) 2021-08-03T12:06:37.246 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:06:37.241+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:37.242704+0000) 2021-08-03T12:06:37.340 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:37.338+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:37.339174+0000) 2021-08-03T12:06:37.372 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:06:37.368+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:37.369525+0000) 2021-08-03T12:06:37.630 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:37.626+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5508 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:37.820 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:37.818+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:37.818846+0000) 2021-08-03T12:06:37.968 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:37.965+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:37.966444+0000) 2021-08-03T12:06:37.975 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:37.974+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:37.974999+0000) 2021-08-03T12:06:38.043 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:38.039+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:38.040573+0000) 2021-08-03T12:06:38.059 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:38.057+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:38.057946+0000) 2021-08-03T12:06:38.675 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:38.465+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4415 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:38.947 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:38.916+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2531 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:39.060 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:39.057+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:39.058500+0000) 2021-08-03T12:06:39.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:39.212+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:39.213313+0000) 2021-08-03T12:06:39.850 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:39.848+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:39.848836+0000) 2021-08-03T12:06:40.062 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:40.058+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:40.059074+0000) 2021-08-03T12:06:40.623 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:40.620+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:40.621669+0000) 2021-08-03T12:06:40.857 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:40.854+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:40.855150+0000) 2021-08-03T12:06:40.895 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:40.892+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:40.893431+0000) 2021-08-03T12:06:41.045 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:41.042+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:41.043077+0000) 2021-08-03T12:06:41.061 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:41.058+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:41.059664+0000) 2021-08-03T12:06:42.062 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:42.059+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:42.060228+0000) 2021-08-03T12:06:42.101 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:42.100+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:42.101175+0000) 2021-08-03T12:06:42.425 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:42.422+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:42.422996+0000) 2021-08-03T12:06:43.062 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:43.060+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:43.060769+0000) 2021-08-03T12:06:43.503 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:43.501+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:43.501826+0000) 2021-08-03T12:06:44.063 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:44.060+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:44.061372+0000) 2021-08-03T12:06:44.505 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:44.503+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:44.504445+0000) 2021-08-03T12:06:45.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:45.020+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:45.021749+0000) 2021-08-03T12:06:45.063 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:45.061+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:45.061939+0000) 2021-08-03T12:06:45.506 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:45.503+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:45.504717+0000) 2021-08-03T12:06:45.909 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:45.906+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4468 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:46.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:46.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:46.021926+0000) 2021-08-03T12:06:46.506 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:46.504+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:46.504923+0000) 2021-08-03T12:06:46.663 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:46.660+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:46.661768+0000) 2021-08-03T12:06:46.750 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:46.747+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:46.748429+0000) 2021-08-03T12:06:47.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:47.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:47.022072+0000) 2021-08-03T12:06:47.213 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:06:47.210+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:47.211267+0000) 2021-08-03T12:06:47.312 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:47.142+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5510 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:47.506 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:47.504+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:47.505045+0000) 2021-08-03T12:06:47.551 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:47.547+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2531 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:48.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:48.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:48.022208+0000) 2021-08-03T12:06:48.418 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:48.415+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:48.416385+0000) 2021-08-03T12:06:48.506 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:48.504+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:48.505279+0000) 2021-08-03T12:06:48.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:48.568+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:48.569667+0000) 2021-08-03T12:06:49.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:49.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:49.022318+0000) 2021-08-03T12:06:49.099 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:49.096+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:49.097026+0000) 2021-08-03T12:06:49.506 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:49.504+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:49.505430+0000) 2021-08-03T12:06:49.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:49.568+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:49.569797+0000) 2021-08-03T12:06:49.671 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:06:49.667+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:49.667954+0000) 2021-08-03T12:06:49.672 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:49.669+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:49.671358+0000) 2021-08-03T12:06:49.701 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:49.698+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:49.700104+0000) 2021-08-03T12:06:50.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:50.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:50.022467+0000) 2021-08-03T12:06:50.100 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:50.097+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:50.097708+0000) 2021-08-03T12:06:50.147 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:50.143+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:50.145236+0000) 2021-08-03T12:06:50.507 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:50.504+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:50.505625+0000) 2021-08-03T12:06:50.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:50.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:50.569919+0000) 2021-08-03T12:06:50.643 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:50.639+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:50.641797+0000) 2021-08-03T12:06:50.702 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:50.699+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:50.701115+0000) 2021-08-03T12:06:51.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:51.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:51.022586+0000) 2021-08-03T12:06:51.100 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:51.097+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:51.098489+0000) 2021-08-03T12:06:51.507 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:51.504+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:51.505764+0000) 2021-08-03T12:06:51.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:51.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:51.570056+0000) 2021-08-03T12:06:51.644 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:51.641+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:51.643502+0000) 2021-08-03T12:06:51.703 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:51.700+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:51.701951+0000) 2021-08-03T12:06:51.744 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:51.722+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4478 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:52.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:52.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:52.022715+0000) 2021-08-03T12:06:52.101 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:52.098+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:52.099024+0000) 2021-08-03T12:06:52.507 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:52.505+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:52.505970+0000) 2021-08-03T12:06:52.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:52.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:52.570194+0000) 2021-08-03T12:06:53.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:53.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:53.022835+0000) 2021-08-03T12:06:53.101 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:53.098+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:53.099605+0000) 2021-08-03T12:06:53.507 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:53.505+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:53.506128+0000) 2021-08-03T12:06:53.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:53.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:53.570346+0000) 2021-08-03T12:06:54.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:54.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:54.022963+0000) 2021-08-03T12:06:54.102 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:54.099+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:54.100190+0000) 2021-08-03T12:06:54.422 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:06:54.417+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5510 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:06:54.507 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:54.505+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:54.506342+0000) 2021-08-03T12:06:54.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:54.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:54.570482+0000) 2021-08-03T12:06:55.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:55.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:55.023089+0000) 2021-08-03T12:06:55.103 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:55.099+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:55.100741+0000) 2021-08-03T12:06:55.508 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:55.505+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:55.506470+0000) 2021-08-03T12:06:55.543 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:06:55.382+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2531 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:06:55.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:55.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:55.570594+0000) 2021-08-03T12:06:56.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:56.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:56.023234+0000) 2021-08-03T12:06:56.103 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:56.100+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:56.101335+0000) 2021-08-03T12:06:56.508 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:56.505+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:56.506676+0000) 2021-08-03T12:06:56.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:56.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:56.570752+0000) 2021-08-03T12:06:57.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:57.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:57.023351+0000) 2021-08-03T12:06:57.104 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:57.101+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:57.102108+0000) 2021-08-03T12:06:57.508 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:57.506+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:57.506845+0000) 2021-08-03T12:06:57.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:57.570+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:57.570837+0000) 2021-08-03T12:06:57.655 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:06:57.652+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:57.653080+0000) 2021-08-03T12:06:57.754 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:06:57.751+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:57.751983+0000) 2021-08-03T12:06:58.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:58.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:58.023474+0000) 2021-08-03T12:06:58.105 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:58.102+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:58.102691+0000) 2021-08-03T12:06:58.117 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:06:57.975+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4504 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:06:58.159 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:06:58.155+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:58.156624+0000) 2021-08-03T12:06:58.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:58.570+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:58.570959+0000) 2021-08-03T12:06:58.983 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:06:58.980+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:58.981580+0000) 2021-08-03T12:06:59.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:59.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:59.023626+0000) 2021-08-03T12:06:59.105 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:06:59.102+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:59.103469+0000) 2021-08-03T12:06:59.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:06:59.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:59.571122+0000) 2021-08-03T12:06:59.861 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:06:59.860+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:06:59.860990+0000) 2021-08-03T12:07:00.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:00.021+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:00.023734+0000) 2021-08-03T12:07:00.106 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:00.102+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:00.104192+0000) 2021-08-03T12:07:00.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:00.244+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:00.246352+0000) 2021-08-03T12:07:00.312 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:00.202+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5510 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:00.316 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:00.311+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:00.313659+0000) 2021-08-03T12:07:00.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:00.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:00.571248+0000) 2021-08-03T12:07:01.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:01.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:01.023874+0000) 2021-08-03T12:07:01.107 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:01.103+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:01.104757+0000) 2021-08-03T12:07:01.210 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:01.207+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:01.209617+0000) 2021-08-03T12:07:01.278 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:01.275+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:01.276388+0000) 2021-08-03T12:07:01.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:01.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:01.571371+0000) 2021-08-03T12:07:02.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:02.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:02.023999+0000) 2021-08-03T12:07:02.107 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:02.103+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:02.105350+0000) 2021-08-03T12:07:02.289 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:02.288+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:02.288960+0000) 2021-08-03T12:07:02.483 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:02.476+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2533 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:02.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:02.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:02.571536+0000) 2021-08-03T12:07:03.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:03.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:03.024164+0000) 2021-08-03T12:07:03.108 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:03.104+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:03.105934+0000) 2021-08-03T12:07:03.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:03.569+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:03.571696+0000) 2021-08-03T12:07:03.779 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:03.776+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:03.777545+0000) 2021-08-03T12:07:03.833 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:03.829+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:03.830804+0000) 2021-08-03T12:07:04.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:04.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:04.024293+0000) 2021-08-03T12:07:04.040 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:04.037+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:04.039305+0000) 2021-08-03T12:07:04.108 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:04.105+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:04.106767+0000) 2021-08-03T12:07:04.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:04.570+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:04.571819+0000) 2021-08-03T12:07:04.586 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:04.582+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:04.584141+0000) 2021-08-03T12:07:05.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:05.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:05.024453+0000) 2021-08-03T12:07:05.109 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:05.105+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:05.107341+0000) 2021-08-03T12:07:05.169 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:05.167+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:05.168670+0000) 2021-08-03T12:07:05.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:05.255+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:05.257415+0000) 2021-08-03T12:07:05.397 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:05.252+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4517 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:05.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:05.570+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:05.571981+0000) 2021-08-03T12:07:06.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:06.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:06.024589+0000) 2021-08-03T12:07:06.067 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:06.063+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:06.065294+0000) 2021-08-03T12:07:06.110 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:06.106+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:06.107903+0000) 2021-08-03T12:07:06.261 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:06.258+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:06.260228+0000) 2021-08-03T12:07:06.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:06.570+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:06.572125+0000) 2021-08-03T12:07:06.629 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:06.626+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:06.627703+0000) 2021-08-03T12:07:07.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:07.022+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:07.024704+0000) 2021-08-03T12:07:07.067 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:07.064+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:07.065975+0000) 2021-08-03T12:07:07.110 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:07.106+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:07.108658+0000) 2021-08-03T12:07:07.261 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:07.258+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:07.260534+0000) 2021-08-03T12:07:07.304 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:07.245+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5510 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:07.434 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:07.431+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:07.432232+0000) 2021-08-03T12:07:07.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:07.570+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:07.572274+0000) 2021-08-03T12:07:07.841 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:07.837+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:07.838154+0000) 2021-08-03T12:07:08.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:08.023+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:08.024831+0000) 2021-08-03T12:07:08.068 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:08.064+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:08.066516+0000) 2021-08-03T12:07:08.111 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:08.107+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:08.109515+0000) 2021-08-03T12:07:08.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:08.258+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:08.260732+0000) 2021-08-03T12:07:08.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:08.571+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:08.572402+0000) 2021-08-03T12:07:08.841 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:08.839+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:08.840157+0000) 2021-08-03T12:07:08.850 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:08.848+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:08.849556+0000) 2021-08-03T12:07:09.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:09.024+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:09.024971+0000) 2021-08-03T12:07:09.068 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:09.066+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:09.067102+0000) 2021-08-03T12:07:09.114 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:09.109+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:09.110112+0000) 2021-08-03T12:07:09.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:09.260+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:09.260879+0000) 2021-08-03T12:07:09.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:09.571+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:09.572557+0000) 2021-08-03T12:07:09.842 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:09.839+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:09.840732+0000) 2021-08-03T12:07:10.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:10.024+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:10.025138+0000) 2021-08-03T12:07:10.069 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:10.066+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:10.067666+0000) 2021-08-03T12:07:10.162 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:09.639+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2535 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:10.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:10.260+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:10.261139+0000) 2021-08-03T12:07:10.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:10.571+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:10.572691+0000) 2021-08-03T12:07:10.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:10.607+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:10.607929+0000) 2021-08-03T12:07:10.611 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:10.607+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:10.608609+0000) 2021-08-03T12:07:10.842 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:10.840+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:10.841533+0000) 2021-08-03T12:07:11.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:11.024+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:11.025270+0000) 2021-08-03T12:07:11.069 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:11.067+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:11.068228+0000) 2021-08-03T12:07:11.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:11.260+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:11.261259+0000) 2021-08-03T12:07:11.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:11.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:11.572857+0000) 2021-08-03T12:07:11.843 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:11.841+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:11.842330+0000) 2021-08-03T12:07:12.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:12.024+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:12.025392+0000) 2021-08-03T12:07:12.070 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:12.068+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:12.068798+0000) 2021-08-03T12:07:12.161 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:12.159+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:12.160549+0000) 2021-08-03T12:07:12.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:12.260+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:12.261446+0000) 2021-08-03T12:07:12.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:12.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:12.573016+0000) 2021-08-03T12:07:12.844 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:12.842+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:12.842923+0000) 2021-08-03T12:07:13.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:13.024+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:13.025526+0000) 2021-08-03T12:07:13.071 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:13.068+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:13.069387+0000) 2021-08-03T12:07:13.163 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:13.160+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:13.161301+0000) 2021-08-03T12:07:13.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:12.885+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4539 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:13.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:13.260+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:13.261633+0000) 2021-08-03T12:07:13.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:13.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:13.573155+0000) 2021-08-03T12:07:13.844 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:13.842+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:13.843493+0000) 2021-08-03T12:07:14.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:14.024+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:14.025657+0000) 2021-08-03T12:07:14.072 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:14.069+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:14.070011+0000) 2021-08-03T12:07:14.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:14.261+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:14.261854+0000) 2021-08-03T12:07:14.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:14.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:14.573284+0000) 2021-08-03T12:07:14.758 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:14.687+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5516 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:14.845 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:14.843+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:14.844067+0000) 2021-08-03T12:07:14.893 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:14.890+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:14.891026+0000) 2021-08-03T12:07:15.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:15.025+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:15.025794+0000) 2021-08-03T12:07:15.072 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:15.069+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:15.070591+0000) 2021-08-03T12:07:15.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:15.261+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:15.262008+0000) 2021-08-03T12:07:15.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:15.314+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:15.315702+0000) 2021-08-03T12:07:15.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:15.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:15.573425+0000) 2021-08-03T12:07:15.846 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:15.843+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:15.844646+0000) 2021-08-03T12:07:16.073 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:16.070+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:16.071195+0000) 2021-08-03T12:07:16.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:16.261+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:16.262244+0000) 2021-08-03T12:07:16.467 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:16.465+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:16.466345+0000) 2021-08-03T12:07:16.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:16.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:16.573559+0000) 2021-08-03T12:07:17.073 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:17.071+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:17.071907+0000) 2021-08-03T12:07:17.414 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:17.410+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:17.411806+0000) 2021-08-03T12:07:17.575 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:17.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:17.573718+0000) 2021-08-03T12:07:18.074 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:18.071+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:18.072473+0000) 2021-08-03T12:07:19.075 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:19.072+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:19.073227+0000) 2021-08-03T12:07:19.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:19.701+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:19.702143+0000) 2021-08-03T12:07:19.917 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:19.914+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:19.914961+0000) 2021-08-03T12:07:20.022 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:19.362+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2540 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:20.076 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:20.073+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:20.073767+0000) 2021-08-03T12:07:20.370 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:20.367+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:20.368147+0000) 2021-08-03T12:07:20.674 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:20.610+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:20.953 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:20.951+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:20.952029+0000) 2021-08-03T12:07:21.076 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:21.073+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:21.074523+0000) 2021-08-03T12:07:21.304 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:21.301+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:21.302789+0000) 2021-08-03T12:07:21.371 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:21.368+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:21.368890+0000) 2021-08-03T12:07:21.467 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:21.463+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:21.464345+0000) 2021-08-03T12:07:21.497 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:21.494+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5516 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:22.077 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:22.074+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:22.075069+0000) 2021-08-03T12:07:23.077 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:23.074+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:23.075632+0000) 2021-08-03T12:07:24.078 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:24.075+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:24.076163+0000) 2021-08-03T12:07:24.402 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:24.399+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:24.400585+0000) 2021-08-03T12:07:24.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:24.775+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:24.776597+0000) 2021-08-03T12:07:24.849 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:24.845+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:24.846471+0000) 2021-08-03T12:07:25.078 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:25.075+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:25.076698+0000) 2021-08-03T12:07:25.150 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:25.147+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:25.148343+0000) 2021-08-03T12:07:25.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:25.355+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:25.356471+0000) 2021-08-03T12:07:25.447 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:25.445+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:25.445978+0000) 2021-08-03T12:07:25.562 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:25.348+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2540 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:25.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:25.775+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:25.776747+0000) 2021-08-03T12:07:26.017 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:26.015+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:26.015863+0000) 2021-08-03T12:07:26.081 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:26.076+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:26.077261+0000) 2021-08-03T12:07:26.220 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:26.216+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:26.217669+0000) 2021-08-03T12:07:26.649 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:26.645+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:26.646697+0000) 2021-08-03T12:07:26.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:26.776+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:26.776870+0000) 2021-08-03T12:07:27.018 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:27.015+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:27.016584+0000) 2021-08-03T12:07:27.470 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:27.469+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:27.470575+0000) 2021-08-03T12:07:27.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:27.776+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:27.777051+0000) 2021-08-03T12:07:27.834 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:27.783+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:28.307 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:28.258+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5516 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:28.976 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:28.974+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:28.975633+0000) 2021-08-03T12:07:29.126 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:29.123+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:29.123886+0000) 2021-08-03T12:07:29.159 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:29.156+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:29.156930+0000) 2021-08-03T12:07:29.487 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:29.481+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:29.482653+0000) 2021-08-03T12:07:29.585 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:29.582+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:29.583127+0000) 2021-08-03T12:07:29.976 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:29.974+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:29.975795+0000) 2021-08-03T12:07:30.126 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:30.123+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:30.124429+0000) 2021-08-03T12:07:30.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:30.134+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:30.135238+0000) 2021-08-03T12:07:30.485 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:30.482+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:30.483088+0000) 2021-08-03T12:07:30.506 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:30.503+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:30.504560+0000) 2021-08-03T12:07:30.842 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:30.840+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:30.841237+0000) 2021-08-03T12:07:30.976 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:30.975+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:30.975936+0000) 2021-08-03T12:07:31.128 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:31.124+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:31.125554+0000) 2021-08-03T12:07:31.295 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:31.293+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:31.294400+0000) 2021-08-03T12:07:31.326 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:31.323+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:31.324652+0000) 2021-08-03T12:07:31.842 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:31.840+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:31.841376+0000) 2021-08-03T12:07:31.976 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:31.975+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:31.976078+0000) 2021-08-03T12:07:32.039 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:32.037+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:32.038747+0000) 2021-08-03T12:07:32.128 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:32.125+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:32.126623+0000) 2021-08-03T12:07:32.274 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:32.266+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2550 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:32.642 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:32.640+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:32.641323+0000) 2021-08-03T12:07:32.842 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:32.840+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:32.841517+0000) 2021-08-03T12:07:32.976 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:32.975+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:32.976214+0000) 2021-08-03T12:07:33.040 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:33.038+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:33.039371+0000) 2021-08-03T12:07:33.129 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:33.126+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:33.127357+0000) 2021-08-03T12:07:33.556 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:33.554+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:33.555614+0000) 2021-08-03T12:07:33.843 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:33.840+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:33.841696+0000) 2021-08-03T12:07:33.976 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:33.975+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:33.976353+0000) 2021-08-03T12:07:34.041 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:34.039+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:34.040010+0000) 2021-08-03T12:07:34.129 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:34.127+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:34.127891+0000) 2021-08-03T12:07:34.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:34.137+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:34.138210+0000) 2021-08-03T12:07:34.166 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:34.164+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:34.165080+0000) 2021-08-03T12:07:34.698 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:34.510+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5527 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:34.843 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:34.841+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:34.841843+0000) 2021-08-03T12:07:34.957 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:34.705+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:35.042 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:35.039+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:35.040615+0000) 2021-08-03T12:07:35.142 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:35.139+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:35.140722+0000) 2021-08-03T12:07:35.742 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:35.738+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:35.739029+0000) 2021-08-03T12:07:35.968 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:35.967+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:35.968470+0000) 2021-08-03T12:07:36.142 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:36.140+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:36.141223+0000) 2021-08-03T12:07:36.568 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:36.565+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:36.566012+0000) 2021-08-03T12:07:36.660 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:36.656+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:36.657584+0000) 2021-08-03T12:07:36.913 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:36.911+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:36.912284+0000) 2021-08-03T12:07:37.142 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:37.140+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:37.141340+0000) 2021-08-03T12:07:37.279 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:37.274+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:37.275699+0000) 2021-08-03T12:07:37.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:37.337+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:37.338296+0000) 2021-08-03T12:07:37.347 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:37.343+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:37.343940+0000) 2021-08-03T12:07:38.142 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:38.140+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:38.141548+0000) 2021-08-03T12:07:38.205 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:38.203+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:38.204409+0000) 2021-08-03T12:07:39.143 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:39.140+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:39.141677+0000) 2021-08-03T12:07:39.225 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:39.222+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:39.222885+0000) 2021-08-03T12:07:39.501 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:39.498+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:39.499252+0000) 2021-08-03T12:07:40.143 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:40.141+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:40.141894+0000) 2021-08-03T12:07:41.143 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:41.141+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:41.142011+0000) 2021-08-03T12:07:41.884 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:41.881+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:41.881840+0000) 2021-08-03T12:07:42.100 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:42.018+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5548 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:42.118 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:42.116+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:42.117382+0000) 2021-08-03T12:07:42.740 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:42.517+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:42.884 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:42.882+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:42.882904+0000) 2021-08-03T12:07:43.122 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:42.662+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2555 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:43.548 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:43.545+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:43.546765+0000) 2021-08-03T12:07:43.886 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:43.883+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:43.884025+0000) 2021-08-03T12:07:44.493 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:44.491+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:44.491836+0000) 2021-08-03T12:07:44.887 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:44.884+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:44.885174+0000) 2021-08-03T12:07:45.236 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:45.233+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:45.233833+0000) 2021-08-03T12:07:45.389 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:45.383+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:45.384122+0000) 2021-08-03T12:07:45.408 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:45.404+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:45.404719+0000) 2021-08-03T12:07:45.417 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:45.415+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:45.416243+0000) 2021-08-03T12:07:45.800 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:45.797+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:45.798043+0000) 2021-08-03T12:07:45.889 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:45.885+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:45.886276+0000) 2021-08-03T12:07:45.974 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:45.971+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:45.972397+0000) 2021-08-03T12:07:46.152 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:46.150+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:46.151238+0000) 2021-08-03T12:07:46.728 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:46.723+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:46.724506+0000) 2021-08-03T12:07:46.889 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:46.886+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:46.887223+0000) 2021-08-03T12:07:47.472 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:47.453+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5552 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:47.827 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:47.824+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:47.825477+0000) 2021-08-03T12:07:47.828 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:47.824+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:47.825513+0000) 2021-08-03T12:07:47.828 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:47.827+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:47.828462+0000) 2021-08-03T12:07:47.890 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:47.887+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:47.888096+0000) 2021-08-03T12:07:48.191 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:47.963+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:48.307 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:48.304+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:48.305040+0000) 2021-08-03T12:07:48.351 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:48.348+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:48.349212+0000) 2021-08-03T12:07:48.827 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:48.825+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:48.826746+0000) 2021-08-03T12:07:49.308 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:49.304+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:49.305707+0000) 2021-08-03T12:07:49.369 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:49.334+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:49.336526+0000) 2021-08-03T12:07:49.828 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:49.826+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:49.827320+0000) 2021-08-03T12:07:49.900 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:49.895+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:49.897661+0000) 2021-08-03T12:07:50.108 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:49.897+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2555 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:50.308 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:50.304+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:50.306530+0000) 2021-08-03T12:07:50.829 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:50.827+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:50.828377+0000) 2021-08-03T12:07:51.161 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:51.158+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:51.158806+0000) 2021-08-03T12:07:51.234 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:51.231+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:51.232312+0000) 2021-08-03T12:07:51.309 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:51.305+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:51.307534+0000) 2021-08-03T12:07:51.830 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:51.828+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:51.828969+0000) 2021-08-03T12:07:51.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:51.905+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:51.907699+0000) 2021-08-03T12:07:52.234 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:52.232+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:52.233328+0000) 2021-08-03T12:07:52.268 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:52.265+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:52.267432+0000) 2021-08-03T12:07:52.310 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:52.306+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:52.308151+0000) 2021-08-03T12:07:52.450 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:52.446+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:52.448686+0000) 2021-08-03T12:07:52.714 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:52.712+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:52.712807+0000) 2021-08-03T12:07:52.831 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:52.828+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:52.829553+0000) 2021-08-03T12:07:52.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:52.906+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:52.907851+0000) 2021-08-03T12:07:53.235 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:53.233+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:53.233964+0000) 2021-08-03T12:07:53.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:53.268+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:53.270006+0000) 2021-08-03T12:07:53.310 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:53.307+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:53.308746+0000) 2021-08-03T12:07:53.451 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:53.447+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:53.449579+0000) 2021-08-03T12:07:53.714 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:53.712+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:53.713485+0000) 2021-08-03T12:07:53.831 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:53.829+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:53.830355+0000) 2021-08-03T12:07:53.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:53.906+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:53.907973+0000) 2021-08-03T12:07:54.236 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:54.233+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.234759+0000) 2021-08-03T12:07:54.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:54.268+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.270414+0000) 2021-08-03T12:07:54.311 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:54.307+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.309341+0000) 2021-08-03T12:07:54.452 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:54.448+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.450370+0000) 2021-08-03T12:07:54.706 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:07:54.701+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5557 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:07:54.715 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:54.713+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.714045+0000) 2021-08-03T12:07:54.832 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:54.830+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.830932+0000) 2021-08-03T12:07:54.874 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:54.871+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.873311+0000) 2021-08-03T12:07:54.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:54.906+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:54.908133+0000) 2021-08-03T12:07:55.236 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:55.234+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:55.235364+0000) 2021-08-03T12:07:55.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:55.268+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:55.270513+0000) 2021-08-03T12:07:55.453 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:55.449+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:55.450945+0000) 2021-08-03T12:07:55.621 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:07:55.611+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4549 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:07:55.643 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:55.639+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:55.641313+0000) 2021-08-03T12:07:55.716 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:55.713+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:55.714651+0000) 2021-08-03T12:07:55.832 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:55.830+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:55.831517+0000) 2021-08-03T12:07:55.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:55.906+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:55.908265+0000) 2021-08-03T12:07:56.237 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:56.235+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:56.236317+0000) 2021-08-03T12:07:56.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:56.268+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:56.270707+0000) 2021-08-03T12:07:56.453 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:56.449+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:56.451544+0000) 2021-08-03T12:07:56.644 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:56.640+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:56.642029+0000) 2021-08-03T12:07:56.716 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:56.714+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:56.715466+0000) 2021-08-03T12:07:56.834 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:56.831+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:56.832705+0000) 2021-08-03T12:07:56.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:56.906+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:56.908379+0000) 2021-08-03T12:07:57.125 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:07:57.119+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.121390+0000) 2021-08-03T12:07:57.238 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:57.236+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.236928+0000) 2021-08-03T12:07:57.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:57.269+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.270857+0000) 2021-08-03T12:07:57.454 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:57.450+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.452162+0000) 2021-08-03T12:07:57.584 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:07:57.581+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.582082+0000) 2021-08-03T12:07:57.647 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:57.641+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.642610+0000) 2021-08-03T12:07:57.717 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:57.715+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.716266+0000) 2021-08-03T12:07:57.834 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:57.832+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.833300+0000) 2021-08-03T12:07:57.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:57.907+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:57.908541+0000) 2021-08-03T12:07:58.023 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:58.020+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.021451+0000) 2021-08-03T12:07:58.065 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:58.063+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.064661+0000) 2021-08-03T12:07:58.238 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:58.236+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.237526+0000) 2021-08-03T12:07:58.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:58.270+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.271025+0000) 2021-08-03T12:07:58.406 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:07:58.403+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2571 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:07:58.410 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:07:58.408+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.408950+0000) 2021-08-03T12:07:58.455 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:58.452+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.452748+0000) 2021-08-03T12:07:58.645 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:58.642+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.643608+0000) 2021-08-03T12:07:58.717 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:58.716+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.716847+0000) 2021-08-03T12:07:58.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:58.776+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.777366+0000) 2021-08-03T12:07:58.835 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:58.833+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.834019+0000) 2021-08-03T12:07:58.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:58.907+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:58.908671+0000) 2021-08-03T12:07:59.024 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:07:59.021+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.022411+0000) 2021-08-03T12:07:59.066 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:59.063+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.064787+0000) 2021-08-03T12:07:59.239 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:07:59.237+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.238360+0000) 2021-08-03T12:07:59.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:59.270+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.271143+0000) 2021-08-03T12:07:59.455 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:07:59.452+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.453355+0000) 2021-08-03T12:07:59.646 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:07:59.643+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.644395+0000) 2021-08-03T12:07:59.719 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:07:59.716+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.717871+0000) 2021-08-03T12:07:59.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:59.776+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.777530+0000) 2021-08-03T12:07:59.835 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:07:59.833+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.834820+0000) 2021-08-03T12:07:59.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:07:59.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:07:59.908802+0000) 2021-08-03T12:08:00.025 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:00.022+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.023012+0000) 2021-08-03T12:08:00.066 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:00.064+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.064913+0000) 2021-08-03T12:08:00.240 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:00.237+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.239001+0000) 2021-08-03T12:08:00.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:00.270+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.271338+0000) 2021-08-03T12:08:00.455 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:00.453+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.453956+0000) 2021-08-03T12:08:00.647 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:00.644+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.645561+0000) 2021-08-03T12:08:00.719 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:00.716+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.718432+0000) 2021-08-03T12:08:00.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:00.776+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.777641+0000) 2021-08-03T12:08:00.836 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:00.833+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.835391+0000) 2021-08-03T12:08:00.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:00.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:00.908925+0000) 2021-08-03T12:08:01.025 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:01.023+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.023826+0000) 2021-08-03T12:08:01.066 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:01.064+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.065050+0000) 2021-08-03T12:08:01.240 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:01.237+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.239591+0000) 2021-08-03T12:08:01.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:01.270+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.271467+0000) 2021-08-03T12:08:01.457 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:01.454+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.454738+0000) 2021-08-03T12:08:01.520 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:01.502+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4559 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:01.649 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:01.645+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.646174+0000) 2021-08-03T12:08:01.720 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:01.717+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.719359+0000) 2021-08-03T12:08:01.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:01.776+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.777761+0000) 2021-08-03T12:08:01.837 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:01.834+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.835972+0000) 2021-08-03T12:08:01.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:01.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:01.909028+0000) 2021-08-03T12:08:02.026 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:02.023+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.024437+0000) 2021-08-03T12:08:02.066 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:02.064+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.065179+0000) 2021-08-03T12:08:02.241 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:02.238+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.240350+0000) 2021-08-03T12:08:02.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:02.270+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.271672+0000) 2021-08-03T12:08:02.350 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:02.312+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:02.457 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:02.454+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.455430+0000) 2021-08-03T12:08:02.649 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:02.646+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.646928+0000) 2021-08-03T12:08:02.721 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:02.718+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.719936+0000) 2021-08-03T12:08:02.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:02.777+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.777932+0000) 2021-08-03T12:08:02.838 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:02.834+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.836553+0000) 2021-08-03T12:08:02.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:02.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.909176+0000) 2021-08-03T12:08:02.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:02.941+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:02.942440+0000) 2021-08-03T12:08:03.027 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:03.024+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.025052+0000) 2021-08-03T12:08:03.066 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:03.064+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.065307+0000) 2021-08-03T12:08:03.242 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:03.239+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.241147+0000) 2021-08-03T12:08:03.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:03.271+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.271826+0000) 2021-08-03T12:08:03.458 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:03.455+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.456156+0000) 2021-08-03T12:08:03.649 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:03.646+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.647688+0000) 2021-08-03T12:08:03.722 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:03.718+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.720654+0000) 2021-08-03T12:08:03.780 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:03.777+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.778076+0000) 2021-08-03T12:08:03.838 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:03.835+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.837183+0000) 2021-08-03T12:08:03.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:03.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:03.909326+0000) 2021-08-03T12:08:04.027 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:04.024+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.025668+0000) 2021-08-03T12:08:04.058 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:04.054+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.056623+0000) 2021-08-03T12:08:04.067 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:04.064+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.065426+0000) 2021-08-03T12:08:04.243 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:04.239+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.241720+0000) 2021-08-03T12:08:04.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:04.271+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.272014+0000) 2021-08-03T12:08:04.459 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:04.456+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.456742+0000) 2021-08-03T12:08:04.650 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:04.647+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.648525+0000) 2021-08-03T12:08:04.675 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:04.672+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.672935+0000) 2021-08-03T12:08:04.722 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:04.719+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.721226+0000) 2021-08-03T12:08:04.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:04.777+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.778229+0000) 2021-08-03T12:08:04.838 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:04.836+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.837812+0000) 2021-08-03T12:08:04.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:04.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.909443+0000) 2021-08-03T12:08:04.977 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:04.974+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:04.976722+0000) 2021-08-03T12:08:05.028 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:05.025+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.026300+0000) 2021-08-03T12:08:05.066 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:05.064+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.065555+0000) 2021-08-03T12:08:05.243 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:05.240+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.242322+0000) 2021-08-03T12:08:05.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:05.271+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.272141+0000) 2021-08-03T12:08:05.459 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:05.456+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.457532+0000) 2021-08-03T12:08:05.651 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:05.648+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.649173+0000) 2021-08-03T12:08:05.723 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:05.720+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.721809+0000) 2021-08-03T12:08:05.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:05.777+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.778383+0000) 2021-08-03T12:08:05.839 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:05.836+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.838674+0000) 2021-08-03T12:08:05.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:05.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.909588+0000) 2021-08-03T12:08:05.920 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:05.653+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2573 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:05.977 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:05.975+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:05.976880+0000) 2021-08-03T12:08:06.029 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:06.026+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.026926+0000) 2021-08-03T12:08:06.067 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:06.064+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.065704+0000) 2021-08-03T12:08:06.244 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:06.241+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.243370+0000) 2021-08-03T12:08:06.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:06.271+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.272341+0000) 2021-08-03T12:08:06.336 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:06.334+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.336196+0000) 2021-08-03T12:08:06.460 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:06.457+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.458149+0000) 2021-08-03T12:08:06.652 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:06.649+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.649865+0000) 2021-08-03T12:08:06.723 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:06.720+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.722412+0000) 2021-08-03T12:08:06.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:06.777+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.778536+0000) 2021-08-03T12:08:06.840 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:06.837+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.839497+0000) 2021-08-03T12:08:06.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:06.908+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.909716+0000) 2021-08-03T12:08:06.977 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:06.975+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:06.977006+0000) 2021-08-03T12:08:07.030 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:07.026+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.027543+0000) 2021-08-03T12:08:07.068 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:07.065+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.065845+0000) 2021-08-03T12:08:07.245 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:07.242+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.244082+0000) 2021-08-03T12:08:07.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:07.271+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.272481+0000) 2021-08-03T12:08:07.461 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:07.458+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.458757+0000) 2021-08-03T12:08:07.652 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:07.649+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.650660+0000) 2021-08-03T12:08:07.724 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:07.722+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.723002+0000) 2021-08-03T12:08:07.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:07.777+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.778687+0000) 2021-08-03T12:08:07.842 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:07.839+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.840325+0000) 2021-08-03T12:08:07.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:07.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.909869+0000) 2021-08-03T12:08:07.977 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:07.976+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:07.977123+0000) 2021-08-03T12:08:08.030 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:08.027+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.028181+0000) 2021-08-03T12:08:08.067 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:08.065+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.066010+0000) 2021-08-03T12:08:08.246 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:08.244+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.245217+0000) 2021-08-03T12:08:08.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:08.271+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.272693+0000) 2021-08-03T12:08:08.310 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:08.028+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4573 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:08.461 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:08.458+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.459386+0000) 2021-08-03T12:08:08.649 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:08.646+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.647625+0000) 2021-08-03T12:08:08.653 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:08.650+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.651405+0000) 2021-08-03T12:08:08.724 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:08.722+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.723600+0000) 2021-08-03T12:08:08.780 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:08.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.778811+0000) 2021-08-03T12:08:08.842 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:08.840+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.841015+0000) 2021-08-03T12:08:08.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:08.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.910007+0000) 2021-08-03T12:08:08.977 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:08.976+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:08.977265+0000) 2021-08-03T12:08:09.031 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:09.028+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.028931+0000) 2021-08-03T12:08:09.067 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:09.065+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.066147+0000) 2021-08-03T12:08:09.247 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:09.245+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.246326+0000) 2021-08-03T12:08:09.274 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:09.272+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.272865+0000) 2021-08-03T12:08:09.346 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:09.296+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5604 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:09.462 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:09.459+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.459971+0000) 2021-08-03T12:08:09.650 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:09.647+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.648324+0000) 2021-08-03T12:08:09.654 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:09.651+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.651962+0000) 2021-08-03T12:08:09.725 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:09.723+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.724210+0000) 2021-08-03T12:08:09.791 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:09.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.778992+0000) 2021-08-03T12:08:09.843 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:09.841+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.842315+0000) 2021-08-03T12:08:09.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:09.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:09.910124+0000) 2021-08-03T12:08:10.032 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:10.028+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.029535+0000) 2021-08-03T12:08:10.248 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:10.246+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.247153+0000) 2021-08-03T12:08:10.274 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:10.272+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.273114+0000) 2021-08-03T12:08:10.462 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:10.460+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.460792+0000) 2021-08-03T12:08:10.650 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:10.648+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.648893+0000) 2021-08-03T12:08:10.654 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:10.651+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.652571+0000) 2021-08-03T12:08:10.726 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:10.723+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.724791+0000) 2021-08-03T12:08:10.780 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:10.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.779147+0000) 2021-08-03T12:08:10.844 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:10.842+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.842897+0000) 2021-08-03T12:08:10.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:10.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:10.910239+0000) 2021-08-03T12:08:11.033 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:11.029+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.030497+0000) 2021-08-03T12:08:11.249 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:11.246+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.247738+0000) 2021-08-03T12:08:11.274 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:11.272+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.273268+0000) 2021-08-03T12:08:11.464 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:11.460+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.461614+0000) 2021-08-03T12:08:11.651 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:11.648+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.649431+0000) 2021-08-03T12:08:11.655 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:11.652+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.653118+0000) 2021-08-03T12:08:11.728 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:11.726+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.727361+0000) 2021-08-03T12:08:11.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:11.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.779298+0000) 2021-08-03T12:08:11.845 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:11.842+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.843503+0000) 2021-08-03T12:08:11.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:11.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:11.910356+0000) 2021-08-03T12:08:12.033 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:12.030+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.031310+0000) 2021-08-03T12:08:12.249 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:12.247+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.248432+0000) 2021-08-03T12:08:12.274 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:12.272+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.273494+0000) 2021-08-03T12:08:12.412 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:12.033+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2573 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:12.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:12.420+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.421172+0000) 2021-08-03T12:08:12.464 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:12.461+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.462476+0000) 2021-08-03T12:08:12.479 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:12.477+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.477978+0000) 2021-08-03T12:08:12.652 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:12.649+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.650174+0000) 2021-08-03T12:08:12.655 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:12.653+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.653895+0000) 2021-08-03T12:08:12.733 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:12.727+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.727989+0000) 2021-08-03T12:08:12.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:12.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.779455+0000) 2021-08-03T12:08:12.845 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:12.843+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.844141+0000) 2021-08-03T12:08:12.911 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:12.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.910521+0000) 2021-08-03T12:08:12.958 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:12.956+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:12.957647+0000) 2021-08-03T12:08:13.034 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:13.031+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.031937+0000) 2021-08-03T12:08:13.250 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:13.248+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.248988+0000) 2021-08-03T12:08:13.465 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:13.462+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.463205+0000) 2021-08-03T12:08:13.652 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:13.650+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.650736+0000) 2021-08-03T12:08:13.656 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:13.653+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.654472+0000) 2021-08-03T12:08:13.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:13.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.779607+0000) 2021-08-03T12:08:13.846 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:13.844+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.844764+0000) 2021-08-03T12:08:13.912 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:13.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:13.910617+0000) 2021-08-03T12:08:14.035 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:14.031+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:14.032493+0000) 2021-08-03T12:08:14.250 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:14.248+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:14.249533+0000) 2021-08-03T12:08:14.465 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:14.463+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:14.463818+0000) 2021-08-03T12:08:14.657 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:14.654+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:14.654990+0000) 2021-08-03T12:08:14.847 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:14.844+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:14.845578+0000) 2021-08-03T12:08:14.881 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:14.879+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:14.879908+0000) 2021-08-03T12:08:14.912 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:14.909+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:14.910739+0000) 2021-08-03T12:08:15.035 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:15.032+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:15.033449+0000) 2021-08-03T12:08:15.251 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:15.249+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:15.250099+0000) 2021-08-03T12:08:15.466 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:15.463+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:15.464434+0000) 2021-08-03T12:08:15.657 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:15.654+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:15.655560+0000) 2021-08-03T12:08:15.810 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:15.647+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5610 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:16.172 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:16.168+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:16.169090+0000) 2021-08-03T12:08:16.467 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:16.464+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:16.465026+0000) 2021-08-03T12:08:16.658 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:16.655+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:16.656177+0000) 2021-08-03T12:08:16.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:16.772+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:16.773745+0000) 2021-08-03T12:08:16.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:16.882+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:16.883016+0000) 2021-08-03T12:08:17.419 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:17.415+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:17.467 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:17.464+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:17.465715+0000) 2021-08-03T12:08:17.488 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:17.463+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4574 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:17.658 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:17.656+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:17.656741+0000) 2021-08-03T12:08:17.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:17.775+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:17.776467+0000) 2021-08-03T12:08:17.810 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:17.807+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:17.807882+0000) 2021-08-03T12:08:18.074 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:18.071+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:18.071959+0000) 2021-08-03T12:08:18.468 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:18.465+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:18.466335+0000) 2021-08-03T12:08:18.660 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:18.657+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:18.657756+0000) 2021-08-03T12:08:18.688 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:18.685+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:18.685972+0000) 2021-08-03T12:08:18.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:18.776+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:18.776898+0000) 2021-08-03T12:08:18.956 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:18.954+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:18.955417+0000) 2021-08-03T12:08:19.469 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:19.466+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:19.466912+0000) 2021-08-03T12:08:19.578 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:19.576+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:19.577244+0000) 2021-08-03T12:08:19.661 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:19.657+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:19.658317+0000) 2021-08-03T12:08:19.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:19.776+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:19.777033+0000) 2021-08-03T12:08:19.869 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:19.866+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:19.867700+0000) 2021-08-03T12:08:20.136 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:20.133+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:20.134045+0000) 2021-08-03T12:08:20.470 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:20.466+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:20.467482+0000) 2021-08-03T12:08:20.661 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:20.658+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:20.659108+0000) 2021-08-03T12:08:20.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:20.776+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:20.777222+0000) 2021-08-03T12:08:21.069 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:21.066+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:21.067767+0000) 2021-08-03T12:08:21.382 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:21.344+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5630 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:22.470 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:22.466+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:22.467166+0000) 2021-08-03T12:08:22.763 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:22.760+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:22.761203+0000) 2021-08-03T12:08:23.531 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:23.519+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2585 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:23.711 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:23.708+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:23.708809+0000) 2021-08-03T12:08:23.886 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:23.883+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:23.883934+0000) 2021-08-03T12:08:23.890 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:23.887+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:23.887887+0000) 2021-08-03T12:08:24.122 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:24.119+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:24.120807+0000) 2021-08-03T12:08:24.463 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:24.384+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4580 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:24.655 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:24.651+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:24.652532+0000) 2021-08-03T12:08:24.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:24.774+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:24.775638+0000) 2021-08-03T12:08:24.779 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:24.778+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:24.779258+0000) 2021-08-03T12:08:25.176 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:25.172+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:25.173776+0000) 2021-08-03T12:08:25.790 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:25.788+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:25.789002+0000) 2021-08-03T12:08:26.047 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:26.043+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:26.044251+0000) 2021-08-03T12:08:26.068 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:26.065+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:26.066551+0000) 2021-08-03T12:08:26.176 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:26.173+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:26.174409+0000) 2021-08-03T12:08:26.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:26.774+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:26.774848+0000) 2021-08-03T12:08:27.069 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:27.067+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:27.067908+0000) 2021-08-03T12:08:27.176 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:27.174+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:27.175028+0000) 2021-08-03T12:08:27.990 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:27.986+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:27.987458+0000) 2021-08-03T12:08:28.069 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:28.068+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:28.068862+0000) 2021-08-03T12:08:28.177 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:28.175+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:28.175846+0000) 2021-08-03T12:08:28.414 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:28.411+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:28.412437+0000) 2021-08-03T12:08:28.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:28.526+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:28.527668+0000) 2021-08-03T12:08:28.829 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:28.626+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5643 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:28.990 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:28.987+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:28.988391+0000) 2021-08-03T12:08:29.159 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:29.157+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:29.157957+0000) 2021-08-03T12:08:29.176 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:29.131+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2586 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:29.178 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:29.176+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:29.177599+0000) 2021-08-03T12:08:29.184 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:29.182+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:29.183144+0000) 2021-08-03T12:08:29.377 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:29.375+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:29.376252+0000) 2021-08-03T12:08:29.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:29.529+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:29.530224+0000) 2021-08-03T12:08:29.780 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:29.778+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:29.779195+0000) 2021-08-03T12:08:30.179 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:30.177+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:30.178225+0000) 2021-08-03T12:08:30.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:30.529+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:30.530657+0000) 2021-08-03T12:08:30.688 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:30.684+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:30.685253+0000) 2021-08-03T12:08:30.792 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:30.768+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4580 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:30.796 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:30.793+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:30.794335+0000) 2021-08-03T12:08:31.180 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:31.178+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:31.178901+0000) 2021-08-03T12:08:31.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:31.529+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:31.530778+0000) 2021-08-03T12:08:31.858 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:31.855+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:31.855948+0000) 2021-08-03T12:08:31.996 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:31.995+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:31.996044+0000) 2021-08-03T12:08:32.328 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:32.325+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:32.326057+0000) 2021-08-03T12:08:33.746 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:33.742+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:33.743420+0000) 2021-08-03T12:08:34.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:34.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:34.779948+0000) 2021-08-03T12:08:34.808 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:34.804+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:34.805629+0000) 2021-08-03T12:08:35.092 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:34.476+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2589 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:35.615 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:35.612+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:35.612884+0000) 2021-08-03T12:08:35.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:35.673+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:35.673964+0000) 2021-08-03T12:08:35.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:35.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:35.780062+0000) 2021-08-03T12:08:35.808 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:35.805+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:35.806579+0000) 2021-08-03T12:08:35.931 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:35.929+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:35.930363+0000) 2021-08-03T12:08:35.944 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:35.867+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5657 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:36.041 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:36.038+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:36.039077+0000) 2021-08-03T12:08:36.169 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:36.166+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:36.167217+0000) 2021-08-03T12:08:36.481 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:36.478+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:36.479519+0000) 2021-08-03T12:08:36.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:36.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:36.780200+0000) 2021-08-03T12:08:36.809 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:36.806+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:36.807359+0000) 2021-08-03T12:08:37.041 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:37.038+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:37.039678+0000) 2021-08-03T12:08:37.172 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:37.167+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:37.167771+0000) 2021-08-03T12:08:37.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:37.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:37.780336+0000) 2021-08-03T12:08:37.809 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:37.806+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:37.807911+0000) 2021-08-03T12:08:38.042 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:38.038+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:38.040293+0000) 2021-08-03T12:08:38.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:38.131+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:38.133533+0000) 2021-08-03T12:08:38.170 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:38.166+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:38.168567+0000) 2021-08-03T12:08:38.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:38.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:38.780471+0000) 2021-08-03T12:08:38.810 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:38.806+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:38.808487+0000) 2021-08-03T12:08:38.994 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:38.899+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4580 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:39.043 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:39.039+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:39.041071+0000) 2021-08-03T12:08:39.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:39.131+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:39.133716+0000) 2021-08-03T12:08:39.282 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:39.279+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:39.281332+0000) 2021-08-03T12:08:39.782 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:39.778+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:39.780640+0000) 2021-08-03T12:08:39.811 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:39.807+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:39.809084+0000) 2021-08-03T12:08:40.043 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:40.039+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:40.041696+0000) 2021-08-03T12:08:40.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:40.132+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:40.133841+0000) 2021-08-03T12:08:40.286 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:40.283+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:40.284898+0000) 2021-08-03T12:08:40.724 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:40.721+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:40.722364+0000) 2021-08-03T12:08:40.782 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:40.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:40.780812+0000) 2021-08-03T12:08:40.811 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:40.807+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:40.809676+0000) 2021-08-03T12:08:41.044 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:41.040+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:41.042345+0000) 2021-08-03T12:08:41.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:41.132+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:41.133979+0000) 2021-08-03T12:08:41.172 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:41.169+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:41.171528+0000) 2021-08-03T12:08:41.286 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:41.283+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:41.285414+0000) 2021-08-03T12:08:41.782 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:41.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:41.780925+0000) 2021-08-03T12:08:41.812 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:41.808+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:41.810524+0000) 2021-08-03T12:08:41.900 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:41.881+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2589 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:42.045 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:42.041+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:42.042915+0000) 2021-08-03T12:08:42.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:42.132+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:42.134121+0000) 2021-08-03T12:08:42.179 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:42.176+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:42.178294+0000) 2021-08-03T12:08:42.286 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:42.283+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:42.285615+0000) 2021-08-03T12:08:42.782 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:42.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:42.781083+0000) 2021-08-03T12:08:42.813 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:42.809+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:42.811072+0000) 2021-08-03T12:08:42.966 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:42.732+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5662 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:43.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:43.132+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:43.134281+0000) 2021-08-03T12:08:43.179 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:43.176+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:43.178420+0000) 2021-08-03T12:08:43.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:43.283+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:43.285743+0000) 2021-08-03T12:08:43.328 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:43.324+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:43.326242+0000) 2021-08-03T12:08:43.522 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:43.519+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:43.520786+0000) 2021-08-03T12:08:43.782 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:43.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:43.781217+0000) 2021-08-03T12:08:43.813 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:43.809+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:43.811678+0000) 2021-08-03T12:08:44.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:44.132+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:44.134439+0000) 2021-08-03T12:08:44.179 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:44.176+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:44.178519+0000) 2021-08-03T12:08:44.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:44.284+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:44.285977+0000) 2021-08-03T12:08:44.329 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:44.325+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:44.326982+0000) 2021-08-03T12:08:44.523 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:44.520+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:44.521525+0000) 2021-08-03T12:08:44.782 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:44.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:44.781351+0000) 2021-08-03T12:08:44.814 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:44.810+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:44.812284+0000) 2021-08-03T12:08:45.076 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:45.074+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.075625+0000) 2021-08-03T12:08:45.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:45.132+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.134549+0000) 2021-08-03T12:08:45.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:45.176+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.178667+0000) 2021-08-03T12:08:45.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:45.284+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.286146+0000) 2021-08-03T12:08:45.329 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:45.325+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.327582+0000) 2021-08-03T12:08:45.523 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:45.521+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.522145+0000) 2021-08-03T12:08:45.572 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:45.419+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4580 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:45.782 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:45.779+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.781517+0000) 2021-08-03T12:08:45.815 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:45.811+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:45.813054+0000) 2021-08-03T12:08:46.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:46.132+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:46.134654+0000) 2021-08-03T12:08:46.179 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:46.177+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:46.178799+0000) 2021-08-03T12:08:46.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:46.284+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:46.286339+0000) 2021-08-03T12:08:46.330 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:46.326+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:46.328196+0000) 2021-08-03T12:08:46.524 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:46.522+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:46.522952+0000) 2021-08-03T12:08:46.783 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:46.780+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:46.781670+0000) 2021-08-03T12:08:46.815 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:46.812+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:46.813658+0000) 2021-08-03T12:08:47.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:47.134+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:47.134841+0000) 2021-08-03T12:08:47.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:47.178+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:47.178946+0000) 2021-08-03T12:08:47.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:47.285+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:47.286499+0000) 2021-08-03T12:08:47.816 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:47.813+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:47.814247+0000) 2021-08-03T12:08:48.031 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:48.027+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:48.028614+0000) 2021-08-03T12:08:48.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:48.134+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:48.134987+0000) 2021-08-03T12:08:48.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:48.178+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:48.179052+0000) 2021-08-03T12:08:48.288 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:48.285+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:48.286787+0000) 2021-08-03T12:08:48.817 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:48.814+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:48.814809+0000) 2021-08-03T12:08:49.138 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:49.134+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:49.135139+0000) 2021-08-03T12:08:49.181 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:49.178+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:49.179202+0000) 2021-08-03T12:08:49.288 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:49.286+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:49.286951+0000) 2021-08-03T12:08:49.299 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:49.296+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:49.297005+0000) 2021-08-03T12:08:49.721 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:49.718+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:49.719049+0000) 2021-08-03T12:08:49.817 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:49.814+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:49.815636+0000) 2021-08-03T12:08:50.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:50.134+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:50.135276+0000) 2021-08-03T12:08:50.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:50.178+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:50.179325+0000) 2021-08-03T12:08:50.258 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:49.906+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5698 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:50.288 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:50.286+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:50.287164+0000) 2021-08-03T12:08:50.299 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:50.296+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:50.297714+0000) 2021-08-03T12:08:50.740 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:50.512+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2593 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:50.804 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:50.800+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:50.801630+0000) 2021-08-03T12:08:50.818 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:50.815+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:50.816201+0000) 2021-08-03T12:08:51.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:51.134+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:51.135437+0000) 2021-08-03T12:08:51.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:51.178+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:51.179456+0000) 2021-08-03T12:08:51.300 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:51.297+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:51.298291+0000) 2021-08-03T12:08:51.329 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:51.326+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:51.327747+0000) 2021-08-03T12:08:51.819 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:51.816+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:51.816802+0000) 2021-08-03T12:08:52.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:52.134+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:52.135590+0000) 2021-08-03T12:08:52.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:52.178+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:52.179586+0000) 2021-08-03T12:08:52.301 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:52.298+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:52.298877+0000) 2021-08-03T12:08:52.819 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:52.816+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:52.817357+0000) 2021-08-03T12:08:52.850 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:52.846+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:52.847567+0000) 2021-08-03T12:08:53.123 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:52.793+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4580 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:08:53.301 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:53.298+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:53.299417+0000) 2021-08-03T12:08:53.819 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:53.817+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:53.817946+0000) 2021-08-03T12:08:53.921 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:53.918+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:53.919642+0000) 2021-08-03T12:08:54.302 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:54.299+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:54.300139+0000) 2021-08-03T12:08:54.820 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:54.817+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:54.818507+0000) 2021-08-03T12:08:55.303 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:55.300+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:55.300885+0000) 2021-08-03T12:08:55.821 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:55.818+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:55.819282+0000) 2021-08-03T12:08:56.303 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:56.300+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:56.301466+0000) 2021-08-03T12:08:56.342 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:08:56.338+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:56.339389+0000) 2021-08-03T12:08:56.388 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:08:56.211+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5720 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:08:56.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:56.539+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:56.540488+0000) 2021-08-03T12:08:56.564 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:56.562+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:56.563302+0000) 2021-08-03T12:08:56.834 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:08:56.546+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2593 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:08:57.304 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:08:57.301+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:57.302245+0000) 2021-08-03T12:08:57.913 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:57.911+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:57.912014+0000) 2021-08-03T12:08:58.038 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:58.036+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:58.037532+0000) 2021-08-03T12:08:58.043 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:08:58.040+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:58.041485+0000) 2021-08-03T12:08:58.816 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:08:58.815+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:58.816472+0000) 2021-08-03T12:08:58.820 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:58.818+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:58.819064+0000) 2021-08-03T12:08:59.041 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:08:59.039+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:59.040115+0000) 2021-08-03T12:08:59.095 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:08:59.092+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:59.093306+0000) 2021-08-03T12:08:59.229 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:08:59.226+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:59.227445+0000) 2021-08-03T12:08:59.361 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:08:59.358+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:59.358990+0000) 2021-08-03T12:08:59.372 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:08:59.368+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:59.368958+0000) 2021-08-03T12:08:59.398 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:08:59.395+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:08:59.396770+0000) 2021-08-03T12:08:59.805 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:08:59.439+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:00.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:00.039+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:00.040559+0000) 2021-08-03T12:09:00.373 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:00.369+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:00.370108+0000) 2021-08-03T12:09:00.669 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:00.665+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:00.666667+0000) 2021-08-03T12:09:00.861 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:00.859+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:00.859854+0000) 2021-08-03T12:09:01.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:01.039+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:01.040724+0000) 2021-08-03T12:09:01.116 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:01.114+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:01.115381+0000) 2021-08-03T12:09:01.669 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:01.666+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:01.667655+0000) 2021-08-03T12:09:01.861 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:01.859+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:01.860602+0000) 2021-08-03T12:09:01.905 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:01.872+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2593 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:02.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:02.024+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.024893+0000) 2021-08-03T12:09:02.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:02.040+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.040854+0000) 2021-08-03T12:09:02.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:02.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.068854+0000) 2021-08-03T12:09:02.116 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:02.114+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.115543+0000) 2021-08-03T12:09:02.188 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:09:02.186+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.186801+0000) 2021-08-03T12:09:02.415 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:02.413+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.413965+0000) 2021-08-03T12:09:02.670 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:02.667+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.668534+0000) 2021-08-03T12:09:02.862 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:02.860+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:02.861583+0000) 2021-08-03T12:09:03.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:03.024+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.025043+0000) 2021-08-03T12:09:03.051 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:03.048+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.048911+0000) 2021-08-03T12:09:03.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:03.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.068948+0000) 2021-08-03T12:09:03.117 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:03.114+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.115675+0000) 2021-08-03T12:09:03.188 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:09:03.186+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.187789+0000) 2021-08-03T12:09:03.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:03.411+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.412523+0000) 2021-08-03T12:09:03.416 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:03.414+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.415067+0000) 2021-08-03T12:09:03.577 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:03.574+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.575563+0000) 2021-08-03T12:09:03.671 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:03.668+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.669116+0000) 2021-08-03T12:09:03.741 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:03.624+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5732 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:03.863 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:03.861+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:03.862240+0000) 2021-08-03T12:09:04.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:04.024+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:04.025160+0000) 2021-08-03T12:09:04.051 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:04.048+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:04.049667+0000) 2021-08-03T12:09:04.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:04.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:04.069072+0000) 2021-08-03T12:09:04.416 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:04.414+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:04.415655+0000) 2021-08-03T12:09:05.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:05.024+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:05.025300+0000) 2021-08-03T12:09:05.052 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:05.049+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:05.050286+0000) 2021-08-03T12:09:05.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:05.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:05.069208+0000) 2021-08-03T12:09:05.417 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:05.415+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:05.416269+0000) 2021-08-03T12:09:06.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:06.024+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:06.025438+0000) 2021-08-03T12:09:06.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:06.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:06.069334+0000) 2021-08-03T12:09:06.085 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:05.943+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4612 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:06.418 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:06.416+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:06.417121+0000) 2021-08-03T12:09:07.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:07.024+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:07.025589+0000) 2021-08-03T12:09:07.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:07.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:07.069451+0000) 2021-08-03T12:09:07.097 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:07.094+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:07.095491+0000) 2021-08-03T12:09:07.295 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:06.970+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2593 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:07.419 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:07.416+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:07.417690+0000) 2021-08-03T12:09:08.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:08.024+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:08.025733+0000) 2021-08-03T12:09:08.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:08.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:08.069582+0000) 2021-08-03T12:09:08.220 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:08.216+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:08.217660+0000) 2021-08-03T12:09:08.419 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:08.417+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:08.418451+0000) 2021-08-03T12:09:08.433 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:08.430+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:08.430716+0000) 2021-08-03T12:09:09.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:09.025+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:09.025850+0000) 2021-08-03T12:09:09.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:09.068+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:09.069713+0000) 2021-08-03T12:09:09.420 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:09.418+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:09.419463+0000) 2021-08-03T12:09:09.433 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:09.430+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:09.431546+0000) 2021-08-03T12:09:09.792 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:09.790+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:09.791338+0000) 2021-08-03T12:09:09.978 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:09.977+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:09.978140+0000) 2021-08-03T12:09:10.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:10.025+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:10.025980+0000) 2021-08-03T12:09:10.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:10.069+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:10.069831+0000) 2021-08-03T12:09:10.421 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:10.418+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:10.420271+0000) 2021-08-03T12:09:10.434 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:10.431+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:10.432522+0000) 2021-08-03T12:09:10.642 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:10.640+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:10.641149+0000) 2021-08-03T12:09:10.795 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:10.793+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:10.793872+0000) 2021-08-03T12:09:10.978 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:10.976+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:10.978310+0000) 2021-08-03T12:09:11.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:11.025+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:11.026163+0000) 2021-08-03T12:09:11.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:11.069+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:11.069979+0000) 2021-08-03T12:09:11.114 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:11.111+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:11.112991+0000) 2021-08-03T12:09:11.275 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:11.223+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5751 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:11.422 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:11.419+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:11.420818+0000) 2021-08-03T12:09:11.428 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:11.425+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:11.426671+0000) 2021-08-03T12:09:11.439 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:11.432+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:11.433172+0000) 2021-08-03T12:09:11.978 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:11.976+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:11.978449+0000) 2021-08-03T12:09:12.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:12.025+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:12.026305+0000) 2021-08-03T12:09:12.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:12.069+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:12.070100+0000) 2021-08-03T12:09:12.114 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:12.111+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:12.113761+0000) 2021-08-03T12:09:12.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:12.231+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:12.232281+0000) 2021-08-03T12:09:12.285 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:12.282+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2593 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:12.422 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:12.419+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:12.421434+0000) 2021-08-03T12:09:12.436 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:12.433+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:12.433769+0000) 2021-08-03T12:09:12.979 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:12.976+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:12.978620+0000) 2021-08-03T12:09:13.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:13.025+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:13.026443+0000) 2021-08-03T12:09:13.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:13.069+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:13.070224+0000) 2021-08-03T12:09:13.115 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:13.112+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:13.114357+0000) 2021-08-03T12:09:13.423 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:13.420+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:13.422163+0000) 2021-08-03T12:09:13.436 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:13.433+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:13.434601+0000) 2021-08-03T12:09:13.636 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:13.632+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:13.634110+0000) 2021-08-03T12:09:13.707 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:13.527+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4612 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:13.979 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:13.976+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:13.978766+0000) 2021-08-03T12:09:14.116 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:14.113+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:14.114954+0000) 2021-08-03T12:09:14.437 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:14.434+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:14.435200+0000) 2021-08-03T12:09:14.706 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:14.703+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:14.704287+0000) 2021-08-03T12:09:14.870 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:14.868+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:14.869402+0000) 2021-08-03T12:09:15.117 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:15.113+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:15.115561+0000) 2021-08-03T12:09:15.601 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:15.597+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:15.597932+0000) 2021-08-03T12:09:15.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:15.675+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:15.676472+0000) 2021-08-03T12:09:15.707 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:15.704+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:15.705058+0000) 2021-08-03T12:09:16.117 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:16.114+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:16.116256+0000) 2021-08-03T12:09:16.611 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:09:16.607+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:16.609817+0000) 2021-08-03T12:09:16.657 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:16.579+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5757 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:16.708 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:16.705+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:16.705689+0000) 2021-08-03T12:09:17.023 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:17.019+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:17.021679+0000) 2021-08-03T12:09:17.117 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:17.115+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:17.116836+0000) 2021-08-03T12:09:17.374 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:17.371+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:17.372622+0000) 2021-08-03T12:09:17.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:17.448+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:17.449397+0000) 2021-08-03T12:09:17.684 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:17.680+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2596 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:17.708 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:17.705+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:17.706502+0000) 2021-08-03T12:09:17.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:17.882+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:17.884426+0000) 2021-08-03T12:09:18.119 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:18.117+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:18.117810+0000) 2021-08-03T12:09:18.203 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:18.200+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:18.201352+0000) 2021-08-03T12:09:18.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:18.448+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:18.449546+0000) 2021-08-03T12:09:18.515 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:18.512+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:18.513047+0000) 2021-08-03T12:09:18.546 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:18.543+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:18.544603+0000) 2021-08-03T12:09:18.709 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:18.706+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:18.707143+0000) 2021-08-03T12:09:19.067 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:19.064+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:19.065184+0000) 2021-08-03T12:09:19.119 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:19.117+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:19.118414+0000) 2021-08-03T12:09:19.203 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:19.201+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:19.202024+0000) 2021-08-03T12:09:19.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:19.448+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:19.449705+0000) 2021-08-03T12:09:19.517 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:19.286+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4612 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:19.618 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:19.614+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:19.615262+0000) 2021-08-03T12:09:20.120 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:20.118+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:20.119024+0000) 2021-08-03T12:09:20.169 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:20.168+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:20.168928+0000) 2021-08-03T12:09:20.203 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:20.202+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:20.202849+0000) 2021-08-03T12:09:20.278 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:20.276+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:20.277291+0000) 2021-08-03T12:09:20.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:20.449+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:20.449847+0000) 2021-08-03T12:09:21.121 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:21.119+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:21.119824+0000) 2021-08-03T12:09:21.204 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:21.202+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:21.203455+0000) 2021-08-03T12:09:21.215 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:21.211+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:21.212566+0000) 2021-08-03T12:09:21.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:21.449+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:21.449958+0000) 2021-08-03T12:09:21.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:21.482+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:21.482927+0000) 2021-08-03T12:09:21.727 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:21.724+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:21.725291+0000) 2021-08-03T12:09:22.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:22.449+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:22.450103+0000) 2021-08-03T12:09:23.091 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:23.032+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5768 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:23.241 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:23.239+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:23.240634+0000) 2021-08-03T12:09:23.283 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:23.281+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:23.281919+0000) 2021-08-03T12:09:23.425 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:23.421+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:23.422751+0000) 2021-08-03T12:09:23.468 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:23.466+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:23.467439+0000) 2021-08-03T12:09:24.514 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:24.512+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:24.513036+0000) 2021-08-03T12:09:24.538 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:24.253+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2596 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:25.568 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:25.564+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:25.565732+0000) 2021-08-03T12:09:26.058 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:26.054+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:26.055648+0000) 2021-08-03T12:09:26.508 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:26.288+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4612 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:26.569 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:26.566+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:26.566730+0000) 2021-08-03T12:09:26.690 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:09:26.687+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:26.688507+0000) 2021-08-03T12:09:27.058 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:27.054+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:27.056358+0000) 2021-08-03T12:09:27.569 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:27.565+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:27.567364+0000) 2021-08-03T12:09:27.651 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:27.646+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:27.648432+0000) 2021-08-03T12:09:27.762 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:27.760+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:27.760923+0000) 2021-08-03T12:09:28.009 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:28.004+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:28.005840+0000) 2021-08-03T12:09:28.059 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:28.055+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:28.056975+0000) 2021-08-03T12:09:28.570 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:28.566+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:28.567955+0000) 2021-08-03T12:09:28.763 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:28.761+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:28.761897+0000) 2021-08-03T12:09:28.765 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:28.762+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:28.764098+0000) 2021-08-03T12:09:29.059 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:29.055+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:29.057601+0000) 2021-08-03T12:09:29.483 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:29.324+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5781 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:29.571 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:29.567+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:29.568732+0000) 2021-08-03T12:09:30.060 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:30.056+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:30.058207+0000) 2021-08-03T12:09:30.493 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:30.488+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:30.489502+0000) 2021-08-03T12:09:30.571 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:30.567+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:30.569555+0000) 2021-08-03T12:09:30.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:30.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:30.945829+0000) 2021-08-03T12:09:31.061 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:31.057+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:31.059041+0000) 2021-08-03T12:09:31.063 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:31.062+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:31.063471+0000) 2021-08-03T12:09:31.572 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:31.568+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:31.570352+0000) 2021-08-03T12:09:31.698 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:31.386+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2596 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:31.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:31.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:31.945978+0000) 2021-08-03T12:09:32.062 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:32.058+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:32.060064+0000) 2021-08-03T12:09:32.265 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:32.262+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:32.263948+0000) 2021-08-03T12:09:32.573 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:32.569+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:32.570961+0000) 2021-08-03T12:09:33.063 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:33.059+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:33.060871+0000) 2021-08-03T12:09:33.452 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:33.448+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:33.449789+0000) 2021-08-03T12:09:33.573 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:33.569+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:33.571579+0000) 2021-08-03T12:09:33.715 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:32.993+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4616 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:33.837 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:33.834+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:33.836256+0000) 2021-08-03T12:09:34.063 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:34.059+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:34.061478+0000) 2021-08-03T12:09:35.242 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:35.239+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:35.240508+0000) 2021-08-03T12:09:35.489 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:35.486+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:35.487762+0000) 2021-08-03T12:09:35.517 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:35.513+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:35.514971+0000) 2021-08-03T12:09:35.543 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:35.541+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:35.541903+0000) 2021-08-03T12:09:35.611 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:35.484+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5802 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:35.615 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:35.612+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:35.613110+0000) 2021-08-03T12:09:36.544 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:36.541+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:36.542487+0000) 2021-08-03T12:09:37.316 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:37.314+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:37.315430+0000) 2021-08-03T12:09:37.557 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:37.553+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:37.554067+0000) 2021-08-03T12:09:37.574 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:37.572+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:37.573756+0000) 2021-08-03T12:09:37.811 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:09:37.807+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:37.808344+0000) 2021-08-03T12:09:38.131 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:37.765+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2596 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:38.190 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:38.188+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:38.189197+0000) 2021-08-03T12:09:38.345 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:38.341+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:38.342058+0000) 2021-08-03T12:09:38.576 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:38.574+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:38.575053+0000) 2021-08-03T12:09:38.812 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:38.809+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:38.810650+0000) 2021-08-03T12:09:38.993 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:38.989+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:38.990325+0000) 2021-08-03T12:09:39.064 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:39.012+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4618 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:39.577 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:39.575+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:39.575869+0000) 2021-08-03T12:09:40.566 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:40.564+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:40.565536+0000) 2021-08-03T12:09:40.577 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:40.575+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:40.576487+0000) 2021-08-03T12:09:40.661 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:40.658+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:40.659769+0000) 2021-08-03T12:09:40.769 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:40.765+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:40.766389+0000) 2021-08-03T12:09:41.578 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:41.576+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:41.577133+0000) 2021-08-03T12:09:42.579 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:42.577+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:42.577986+0000) 2021-08-03T12:09:43.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:43.070+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:43.071304+0000) 2021-08-03T12:09:43.102 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:43.099+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:43.100651+0000) 2021-08-03T12:09:43.580 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:43.578+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:43.578816+0000) 2021-08-03T12:09:43.710 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:43.707+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5816 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:43.846 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:43.842+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:43.843621+0000) 2021-08-03T12:09:44.044 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:43.975+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2598 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:44.103 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:44.100+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.101372+0000) 2021-08-03T12:09:44.162 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:44.159+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.160774+0000) 2021-08-03T12:09:44.328 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:44.324+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.325537+0000) 2021-08-03T12:09:44.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:44.473+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.474407+0000) 2021-08-03T12:09:44.580 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:44.578+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.579706+0000) 2021-08-03T12:09:44.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:44.859+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.860235+0000) 2021-08-03T12:09:44.962 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:44.959+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.959922+0000) 2021-08-03T12:09:44.979 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:44.978+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:44.979167+0000) 2021-08-03T12:09:45.028 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:45.025+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.026309+0000) 2021-08-03T12:09:45.103 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:45.101+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.102015+0000) 2021-08-03T12:09:45.118 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:45.092+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4618 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:45.581 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:45.579+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.580319+0000) 2021-08-03T12:09:45.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:45.635+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.636419+0000) 2021-08-03T12:09:45.674 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:45.672+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.673521+0000) 2021-08-03T12:09:45.732 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:45.730+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.731352+0000) 2021-08-03T12:09:45.864 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:45.861+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.862745+0000) 2021-08-03T12:09:45.979 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:45.978+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:45.979315+0000) 2021-08-03T12:09:46.029 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:46.026+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:46.026867+0000) 2021-08-03T12:09:46.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:46.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:46.089867+0000) 2021-08-03T12:09:46.107 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:46.103+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:46.104187+0000) 2021-08-03T12:09:46.129 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:46.125+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:46.125795+0000) 2021-08-03T12:09:46.582 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:46.580+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:46.581135+0000) 2021-08-03T12:09:46.866 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:46.864+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:46.865292+0000) 2021-08-03T12:09:46.979 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:46.978+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:46.979447+0000) 2021-08-03T12:09:47.029 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:47.026+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:47.027628+0000) 2021-08-03T12:09:47.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:47.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:47.089975+0000) 2021-08-03T12:09:47.559 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:47.556+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:47.557626+0000) 2021-08-03T12:09:47.583 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:47.580+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:47.581761+0000) 2021-08-03T12:09:47.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:47.864+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:47.865791+0000) 2021-08-03T12:09:47.979 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:47.978+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:47.979584+0000) 2021-08-03T12:09:48.030 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:48.027+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:48.028200+0000) 2021-08-03T12:09:48.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:48.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:48.090085+0000) 2021-08-03T12:09:48.293 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:09:48.290+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:48.291218+0000) 2021-08-03T12:09:48.583 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:48.581+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:48.582378+0000) 2021-08-03T12:09:48.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:48.865+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:48.865971+0000) 2021-08-03T12:09:48.980 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:48.978+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:48.979722+0000) 2021-08-03T12:09:49.031 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:49.028+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:49.028788+0000) 2021-08-03T12:09:49.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:49.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:49.090229+0000) 2021-08-03T12:09:49.584 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:49.582+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:49.582976+0000) 2021-08-03T12:09:49.812 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:49.806+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:49.807409+0000) 2021-08-03T12:09:49.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:49.865+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:49.866132+0000) 2021-08-03T12:09:49.980 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:49.978+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:49.979867+0000) 2021-08-03T12:09:50.031 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:50.028+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:50.029397+0000) 2021-08-03T12:09:50.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:50.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:50.090366+0000) 2021-08-03T12:09:50.584 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:50.582+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:50.583578+0000) 2021-08-03T12:09:50.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:50.865+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:50.866361+0000) 2021-08-03T12:09:50.980 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:50.979+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:50.980000+0000) 2021-08-03T12:09:51.032 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:51.029+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:51.029942+0000) 2021-08-03T12:09:51.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:51.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:51.090489+0000) 2021-08-03T12:09:51.251 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:51.244+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4631 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:51.271 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:51.265+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5819 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:51.425 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:51.423+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:51.423970+0000) 2021-08-03T12:09:51.585 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:51.583+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:51.584373+0000) 2021-08-03T12:09:51.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:51.865+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:51.866475+0000) 2021-08-03T12:09:51.980 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:51.979+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:51.980126+0000) 2021-08-03T12:09:51.989 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:51.855+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2599 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:52.032 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:52.029+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:52.030539+0000) 2021-08-03T12:09:52.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:52.414+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:52.415181+0000) 2021-08-03T12:09:52.586 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:52.584+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:52.585000+0000) 2021-08-03T12:09:52.980 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:52.979+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:52.980278+0000) 2021-08-03T12:09:53.231 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:09:53.228+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:53.229077+0000) 2021-08-03T12:09:53.509 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:53.507+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:53.508286+0000) 2021-08-03T12:09:53.587 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:53.584+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:53.585626+0000) 2021-08-03T12:09:53.665 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:09:53.662+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:53.663175+0000) 2021-08-03T12:09:53.676 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:09:53.672+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:53.673326+0000) 2021-08-03T12:09:53.980 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:53.979+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:53.980406+0000) 2021-08-03T12:09:54.147 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:54.144+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:54.145730+0000) 2021-08-03T12:09:54.197 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:54.195+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:54.196665+0000) 2021-08-03T12:09:54.510 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:54.508+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:54.508944+0000) 2021-08-03T12:09:54.587 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:54.585+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:54.586238+0000) 2021-08-03T12:09:54.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:54.777+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:54.778183+0000) 2021-08-03T12:09:54.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:54.979+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:54.980561+0000) 2021-08-03T12:09:55.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:55.196+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:55.196808+0000) 2021-08-03T12:09:55.510 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:55.508+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:55.509534+0000) 2021-08-03T12:09:55.588 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:55.586+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:55.586880+0000) 2021-08-03T12:09:55.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:55.979+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:55.980711+0000) 2021-08-03T12:09:56.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:56.196+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:56.196974+0000) 2021-08-03T12:09:56.432 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:56.430+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:56.430823+0000) 2021-08-03T12:09:56.511 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:56.509+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:56.510342+0000) 2021-08-03T12:09:56.588 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:56.587+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:56.587877+0000) 2021-08-03T12:09:56.785 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:56.783+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:56.784111+0000) 2021-08-03T12:09:56.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:56.979+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:56.980850+0000) 2021-08-03T12:09:57.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:57.196+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:57.197101+0000) 2021-08-03T12:09:57.512 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:57.510+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:57.511006+0000) 2021-08-03T12:09:57.533 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:09:57.430+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5844 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:09:57.589 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:57.587+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:57.588284+0000) 2021-08-03T12:09:57.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:57.980+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:57.980982+0000) 2021-08-03T12:09:57.991 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:09:57.989+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4637 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:09:58.121 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:09:58.118+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:58.118966+0000) 2021-08-03T12:09:58.512 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:58.510+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:58.511597+0000) 2021-08-03T12:09:58.545 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:09:58.121+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2599 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:09:58.590 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:58.588+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:58.588894+0000) 2021-08-03T12:09:58.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:58.980+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:58.981098+0000) 2021-08-03T12:09:59.513 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:09:59.511+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:59.512268+0000) 2021-08-03T12:09:59.568 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:09:59.564+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:59.565254+0000) 2021-08-03T12:09:59.590 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:09:59.588+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:59.589492+0000) 2021-08-03T12:09:59.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:09:59.627+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:59.628118+0000) 2021-08-03T12:09:59.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:09:59.980+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:09:59.981215+0000) 2021-08-03T12:10:00.514 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:00.512+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:00.513525+0000) 2021-08-03T12:10:00.591 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:00.589+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:00.590524+0000) 2021-08-03T12:10:00.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:00.980+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:00.981340+0000) 2021-08-03T12:10:01.515 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:01.513+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:01.514365+0000) 2021-08-03T12:10:01.592 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:01.590+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:01.591159+0000) 2021-08-03T12:10:01.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:01.980+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:01.981497+0000) 2021-08-03T12:10:02.422 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:02.420+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:02.421531+0000) 2021-08-03T12:10:02.516 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:02.514+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:02.514963+0000) 2021-08-03T12:10:02.593 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:02.590+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:02.591755+0000) 2021-08-03T12:10:02.671 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:02.667+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:02.668435+0000) 2021-08-03T12:10:02.982 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:02.980+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:02.981637+0000) 2021-08-03T12:10:03.384 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:03.382+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:03.382915+0000) 2021-08-03T12:10:03.517 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:03.514+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:03.515752+0000) 2021-08-03T12:10:03.593 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:03.591+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:03.592354+0000) 2021-08-03T12:10:03.982 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:03.980+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:03.981760+0000) 2021-08-03T12:10:03.983 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:03.909+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5846 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:04.201 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:04.199+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:04.199946+0000) 2021-08-03T12:10:04.517 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:04.515+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:04.516436+0000) 2021-08-03T12:10:04.601 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:04.599+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:04.600195+0000) 2021-08-03T12:10:04.606 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:10:04.603+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:04.604582+0000) 2021-08-03T12:10:04.611 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:04.296+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2611 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:04.645 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:04.642+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4637 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:04.982 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:04.981+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:04.981885+0000) 2021-08-03T12:10:05.202 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:05.200+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:05.201096+0000) 2021-08-03T12:10:05.518 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:05.516+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:05.516992+0000) 2021-08-03T12:10:06.203 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:06.200+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:06.201682+0000) 2021-08-03T12:10:06.519 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:06.516+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:06.517556+0000) 2021-08-03T12:10:06.688 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:06.684+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:06.684789+0000) 2021-08-03T12:10:06.814 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:06.810+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:06.810788+0000) 2021-08-03T12:10:07.204 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:07.201+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:07.202314+0000) 2021-08-03T12:10:07.519 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:07.517+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:07.518212+0000) 2021-08-03T12:10:07.520 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:07.517+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:07.518350+0000) 2021-08-03T12:10:08.017 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:08.014+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:08.015252+0000) 2021-08-03T12:10:08.204 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:08.202+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:08.202878+0000) 2021-08-03T12:10:08.223 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:08.221+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:08.221825+0000) 2021-08-03T12:10:08.280 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:08.279+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:08.279942+0000) 2021-08-03T12:10:08.323 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:08.321+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:08.322489+0000) 2021-08-03T12:10:08.521 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:08.518+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:08.519653+0000) 2021-08-03T12:10:09.018 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:09.015+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:09.015974+0000) 2021-08-03T12:10:09.204 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:09.202+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:09.203495+0000) 2021-08-03T12:10:09.224 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:09.221+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:09.222479+0000) 2021-08-03T12:10:09.324 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:09.321+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:09.322642+0000) 2021-08-03T12:10:09.522 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:09.519+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:09.520469+0000) 2021-08-03T12:10:10.012 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:10.008+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:10.008960+0000) 2021-08-03T12:10:10.018 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:10.015+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:10.016579+0000) 2021-08-03T12:10:10.205 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:10.203+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:10.204313+0000) 2021-08-03T12:10:10.225 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:10.222+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:10.223428+0000) 2021-08-03T12:10:10.324 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:10.321+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:10.322765+0000) 2021-08-03T12:10:10.370 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:10.368+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:10.369438+0000) 2021-08-03T12:10:10.380 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:10.377+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5865 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:10.522 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:10.520+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:10.521089+0000) 2021-08-03T12:10:11.099 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:11.097+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:11.098430+0000) 2021-08-03T12:10:11.206 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:11.204+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:11.204946+0000) 2021-08-03T12:10:11.217 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:11.214+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:11.214891+0000) 2021-08-03T12:10:11.225 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:11.223+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:11.223994+0000) 2021-08-03T12:10:11.324 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:11.322+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:11.322945+0000) 2021-08-03T12:10:11.348 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:11.346+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:11.347526+0000) 2021-08-03T12:10:11.523 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:11.521+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:11.522362+0000) 2021-08-03T12:10:12.095 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:12.093+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:12.094116+0000) 2021-08-03T12:10:12.206 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:12.204+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:12.205533+0000) 2021-08-03T12:10:12.226 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:12.223+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:12.224612+0000) 2021-08-03T12:10:12.276 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:12.202+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2612 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:12.302 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:12.192+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4653 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:12.524 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:12.522+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:12.522929+0000) 2021-08-03T12:10:13.207 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:13.205+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:13.206054+0000) 2021-08-03T12:10:13.389 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:10:13.387+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:13.388194+0000) 2021-08-03T12:10:13.535 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:13.532+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:13.532851+0000) 2021-08-03T12:10:13.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:13.883+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:13.883930+0000) 2021-08-03T12:10:14.612 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:14.609+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:14.610059+0000) 2021-08-03T12:10:16.074 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:16.069+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:16.071600+0000) 2021-08-03T12:10:17.040 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:17.039+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:17.040006+0000) 2021-08-03T12:10:17.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:17.782+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:17.784532+0000) 2021-08-03T12:10:18.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:18.314+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:18.315528+0000) 2021-08-03T12:10:18.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:18.782+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:18.784676+0000) 2021-08-03T12:10:18.899 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:18.891+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5872 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:18.903 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:18.899+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:18.901632+0000) 2021-08-03T12:10:19.105 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:19.102+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:19.104100+0000) 2021-08-03T12:10:19.301 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:19.195+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2612 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:19.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:19.313+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:19.315671+0000) 2021-08-03T12:10:19.445 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:10:19.442+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:19.444077+0000) 2021-08-03T12:10:19.523 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:19.505+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4685 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:19.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:19.577+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:19.579649+0000) 2021-08-03T12:10:19.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:19.783+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:19.784839+0000) 2021-08-03T12:10:20.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:20.313+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:20.315806+0000) 2021-08-03T12:10:20.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:20.555+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:20.557733+0000) 2021-08-03T12:10:20.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:20.783+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:20.784978+0000) 2021-08-03T12:10:21.078 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:21.074+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:21.076127+0000) 2021-08-03T12:10:21.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:21.314+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:21.315944+0000) 2021-08-03T12:10:21.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:21.783+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:21.785104+0000) 2021-08-03T12:10:22.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:22.314+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:22.316078+0000) 2021-08-03T12:10:22.399 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:22.394+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:22.396313+0000) 2021-08-03T12:10:22.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:22.446+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:22.448320+0000) 2021-08-03T12:10:22.678 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:22.674+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:22.675937+0000) 2021-08-03T12:10:22.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:22.783+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:22.785246+0000) 2021-08-03T12:10:23.313 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:23.309+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:23.311011+0000) 2021-08-03T12:10:23.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:23.314+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:23.316212+0000) 2021-08-03T12:10:23.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:23.446+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:23.448470+0000) 2021-08-03T12:10:23.678 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:23.674+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:23.676669+0000) 2021-08-03T12:10:23.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:23.783+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:23.785379+0000) 2021-08-03T12:10:24.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:24.314+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:24.316346+0000) 2021-08-03T12:10:24.450 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:24.446+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:24.448631+0000) 2021-08-03T12:10:24.679 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:24.675+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:24.677289+0000) 2021-08-03T12:10:24.703 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:24.613+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4699 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:24.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:24.783+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:24.785498+0000) 2021-08-03T12:10:25.072 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:25.068+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:25.069760+0000) 2021-08-03T12:10:25.172 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:25.094+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5882 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:25.175 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:25.171+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:25.172975+0000) 2021-08-03T12:10:25.310 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:10:25.306+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:25.307912+0000) 2021-08-03T12:10:25.316 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:25.314+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:25.316483+0000) 2021-08-03T12:10:25.439 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:25.149+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2612 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:25.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:25.447+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:25.448748+0000) 2021-08-03T12:10:25.679 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:25.677+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:25.677904+0000) 2021-08-03T12:10:25.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:25.784+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:25.785659+0000) 2021-08-03T12:10:26.073 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:26.069+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:26.070481+0000) 2021-08-03T12:10:26.317 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:26.315+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:26.316618+0000) 2021-08-03T12:10:26.450 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:26.448+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:26.448878+0000) 2021-08-03T12:10:26.560 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T12:10:26.559+0000 7f57d4fe3700 0 -- 172.21.15.3:0/3813029560 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f57b00075e0 msgr2=0x7f57b401a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-03T12:10:26.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:26.784+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:26.785789+0000) 2021-08-03T12:10:27.073 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:27.070+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:27.071221+0000) 2021-08-03T12:10:27.317 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:27.315+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:27.316754+0000) 2021-08-03T12:10:27.493 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:27.491+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:27.491845+0000) 2021-08-03T12:10:27.774 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:27.771+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:27.771959+0000) 2021-08-03T12:10:27.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:27.785+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:27.785944+0000) 2021-08-03T12:10:28.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:28.228+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:28.228895+0000) 2021-08-03T12:10:28.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:28.785+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:28.786105+0000) 2021-08-03T12:10:29.644 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:29.625+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4699 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:29.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:29.785+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:29.786247+0000) 2021-08-03T12:10:29.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:29.856+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:29.857241+0000) 2021-08-03T12:10:30.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:30.059+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:30.059860+0000) 2021-08-03T12:10:30.158 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:30.155+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:30.156688+0000) 2021-08-03T12:10:30.238 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:30.236+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:30.237139+0000) 2021-08-03T12:10:30.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:30.785+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:30.786395+0000) 2021-08-03T12:10:30.837 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:30.835+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:30.836198+0000) 2021-08-03T12:10:31.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:31.059+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:31.060004+0000) 2021-08-03T12:10:31.239 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:31.237+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:31.237883+0000) 2021-08-03T12:10:31.572 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:31.571+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:31.572502+0000) 2021-08-03T12:10:31.579 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:31.575+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:31.576585+0000) 2021-08-03T12:10:31.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:31.785+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:31.786536+0000) 2021-08-03T12:10:31.840 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:31.838+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:31.839745+0000) 2021-08-03T12:10:31.911 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:31.752+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2612 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:32.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:32.059+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:32.060133+0000) 2021-08-03T12:10:32.239 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:32.237+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:32.238470+0000) 2021-08-03T12:10:32.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:32.785+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:32.786674+0000) 2021-08-03T12:10:32.841 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:32.839+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:32.840453+0000) 2021-08-03T12:10:33.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:33.059+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:33.060316+0000) 2021-08-03T12:10:33.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:33.786+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:33.786839+0000) 2021-08-03T12:10:33.841 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:33.839+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:33.840584+0000) 2021-08-03T12:10:33.849 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:33.844+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5895 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:34.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:34.059+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:34.060474+0000) 2021-08-03T12:10:34.353 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:10:34.349+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:34.350641+0000) 2021-08-03T12:10:34.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:34.786+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:34.787002+0000) 2021-08-03T12:10:35.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:35.059+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:35.060648+0000) 2021-08-03T12:10:35.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:34.701+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4699 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:35.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:35.786+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:35.787117+0000) 2021-08-03T12:10:36.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:36.059+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:36.060798+0000) 2021-08-03T12:10:36.721 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:36.717+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:36.718662+0000) 2021-08-03T12:10:36.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:36.786+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:36.787242+0000) 2021-08-03T12:10:37.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:37.060+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:37.060894+0000) 2021-08-03T12:10:37.575 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:37.573+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:37.574298+0000) 2021-08-03T12:10:37.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:37.786+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:37.787402+0000) 2021-08-03T12:10:37.833 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:37.831+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:37.831851+0000) 2021-08-03T12:10:38.046 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:37.783+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2618 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:38.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:38.060+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:38.061069+0000) 2021-08-03T12:10:38.527 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:38.523+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:38.524271+0000) 2021-08-03T12:10:38.574 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:38.571+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:38.572471+0000) 2021-08-03T12:10:38.575 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:38.573+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:38.574447+0000) 2021-08-03T12:10:38.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:38.786+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:38.787546+0000) 2021-08-03T12:10:38.850 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:38.848+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:38.849204+0000) 2021-08-03T12:10:38.940 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:38.937+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:38.937778+0000) 2021-08-03T12:10:39.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:39.060+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:39.061198+0000) 2021-08-03T12:10:39.082 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:38.885+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5896 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:39.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:39.786+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:39.787731+0000) 2021-08-03T12:10:39.851 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:39.849+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:39.849838+0000) 2021-08-03T12:10:40.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:40.060+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:40.061357+0000) 2021-08-03T12:10:40.401 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:40.382+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:40.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:40.787+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:40.787862+0000) 2021-08-03T12:10:40.851 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:40.849+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:40.850471+0000) 2021-08-03T12:10:41.651 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:41.649+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:41.650607+0000) 2021-08-03T12:10:41.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:41.787+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:41.787980+0000) 2021-08-03T12:10:41.852 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:41.850+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:41.851098+0000) 2021-08-03T12:10:42.651 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:42.649+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:42.650766+0000) 2021-08-03T12:10:42.762 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:42.756+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:42.757135+0000) 2021-08-03T12:10:42.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:42.787+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:42.788150+0000) 2021-08-03T12:10:42.852 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:42.850+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:42.851704+0000) 2021-08-03T12:10:43.651 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:43.650+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:43.650919+0000) 2021-08-03T12:10:43.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:43.787+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:43.788304+0000) 2021-08-03T12:10:43.853 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:43.851+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:43.852329+0000) 2021-08-03T12:10:44.512 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:44.509+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:44.510772+0000) 2021-08-03T12:10:44.651 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:44.650+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:44.651058+0000) 2021-08-03T12:10:44.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:44.787+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:44.788459+0000) 2021-08-03T12:10:44.830 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:10:44.826+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:44.827761+0000) 2021-08-03T12:10:44.855 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:44.852+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:44.853613+0000) 2021-08-03T12:10:45.133 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:45.096+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5917 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:45.374 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:45.370+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:45.371283+0000) 2021-08-03T12:10:45.379 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:45.377+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:45.378651+0000) 2021-08-03T12:10:45.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:45.787+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:45.788581+0000) 2021-08-03T12:10:45.855 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:45.853+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:45.854232+0000) 2021-08-03T12:10:45.971 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:45.799+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2624 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:46.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:46.787+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:46.788718+0000) 2021-08-03T12:10:46.855 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:46.854+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:46.854827+0000) 2021-08-03T12:10:46.906 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:46.904+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:47.059 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:47.058+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:47.059491+0000) 2021-08-03T12:10:47.175 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:47.171+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:47.171977+0000) 2021-08-03T12:10:47.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:47.408+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:47.408877+0000) 2021-08-03T12:10:47.579 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:47.576+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:47.577214+0000) 2021-08-03T12:10:47.606 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:10:47.604+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:47.605265+0000) 2021-08-03T12:10:47.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:47.788+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:47.788865+0000) 2021-08-03T12:10:47.856 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:47.854+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:47.855420+0000) 2021-08-03T12:10:48.485 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:48.480+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:48.481667+0000) 2021-08-03T12:10:48.857 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:48.855+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:48.856039+0000) 2021-08-03T12:10:49.173 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:49.171+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:49.172650+0000) 2021-08-03T12:10:49.183 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:49.181+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:49.182630+0000) 2021-08-03T12:10:49.292 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:10:49.288+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:49.289371+0000) 2021-08-03T12:10:49.465 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:49.462+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:49.463569+0000) 2021-08-03T12:10:49.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:49.699+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:49.699856+0000) 2021-08-03T12:10:50.449 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:50.446+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:50.447085+0000) 2021-08-03T12:10:50.466 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:50.463+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:50.464623+0000) 2021-08-03T12:10:50.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:50.699+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:50.700011+0000) 2021-08-03T12:10:50.811 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:50.809+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5934 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:51.205 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:51.202+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:51.203528+0000) 2021-08-03T12:10:51.468 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:51.464+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:51.465731+0000) 2021-08-03T12:10:51.998 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:51.997+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:51.998012+0000) 2021-08-03T12:10:52.011 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:10:52.007+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:52.008430+0000) 2021-08-03T12:10:52.179 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:52.175+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2626 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:52.206 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:52.203+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:52.204263+0000) 2021-08-03T12:10:52.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:52.448+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:52.449636+0000) 2021-08-03T12:10:52.451 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:10:52.448+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:52.448932+0000) 2021-08-03T12:10:52.469 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:10:52.465+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:52.466628+0000) 2021-08-03T12:10:52.665 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:52.663+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:52.663856+0000) 2021-08-03T12:10:52.974 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:10:52.972+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:52.972978+0000) 2021-08-03T12:10:53.181 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:10:53.164+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:10:53.716 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:53.714+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:53.715047+0000) 2021-08-03T12:10:54.716 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:54.714+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:54.715194+0000) 2021-08-03T12:10:55.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:55.248+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:55.249101+0000) 2021-08-03T12:10:55.716 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:55.714+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:55.715308+0000) 2021-08-03T12:10:56.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:56.248+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:56.249243+0000) 2021-08-03T12:10:56.716 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:56.714+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:56.715445+0000) 2021-08-03T12:10:57.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:57.248+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:57.249403+0000) 2021-08-03T12:10:57.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:57.714+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:57.715601+0000) 2021-08-03T12:10:58.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:58.248+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:58.249556+0000) 2021-08-03T12:10:58.312 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:10:57.939+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5949 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:10:58.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:58.714+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:58.715712+0000) 2021-08-03T12:10:58.942 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:10:58.939+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:58.939851+0000) 2021-08-03T12:10:58.985 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:58.983+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:58.984828+0000) 2021-08-03T12:10:59.186 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:10:58.932+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2628 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:10:59.251 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:59.248+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:59.249690+0000) 2021-08-03T12:10:59.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:10:59.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:59.715880+0000) 2021-08-03T12:10:59.985 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:10:59.984+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:59.984988+0000) 2021-08-03T12:10:59.990 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:10:59.988+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:10:59.989646+0000) 2021-08-03T12:11:00.251 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:00.249+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:00.249827+0000) 2021-08-03T12:11:00.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:00.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:00.715993+0000) 2021-08-03T12:11:00.960 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:00.432+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:00.991 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:00.989+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:00.990380+0000) 2021-08-03T12:11:01.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:01.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:01.716137+0000) 2021-08-03T12:11:01.992 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:01.990+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:01.990978+0000) 2021-08-03T12:11:02.118 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:02.116+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:02.117384+0000) 2021-08-03T12:11:02.621 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:02.617+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:02.618618+0000) 2021-08-03T12:11:02.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:02.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:02.716286+0000) 2021-08-03T12:11:02.992 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:02.990+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:02.991597+0000) 2021-08-03T12:11:03.231 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:11:03.228+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:03.228974+0000) 2021-08-03T12:11:03.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:03.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:03.716424+0000) 2021-08-03T12:11:03.950 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:03.948+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:03.948828+0000) 2021-08-03T12:11:03.993 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:03.991+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:03.992410+0000) 2021-08-03T12:11:04.260 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:04.251+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5963 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:04.437 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:04.435+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:04.436706+0000) 2021-08-03T12:11:04.479 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:11:04.477+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:04.478254+0000) 2021-08-03T12:11:04.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:04.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:04.716552+0000) 2021-08-03T12:11:04.769 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:11:04.766+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:04.766959+0000) 2021-08-03T12:11:05.238 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:05.235+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:05.236849+0000) 2021-08-03T12:11:05.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:05.714+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:05.716690+0000) 2021-08-03T12:11:06.718 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:06.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:06.716842+0000) 2021-08-03T12:11:07.718 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:07.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:07.716984+0000) 2021-08-03T12:11:08.718 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:08.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:08.717159+0000) 2021-08-03T12:11:08.883 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:08.804+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:09.506 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:11:09.224+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2630 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:11:09.718 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:09.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:09.717324+0000) 2021-08-03T12:11:10.478 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:10.475+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:10.476240+0000) 2021-08-03T12:11:10.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:10.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:10.717445+0000) 2021-08-03T12:11:10.751 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:10.716+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5977 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:11.028 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:11.023+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:11.025695+0000) 2021-08-03T12:11:11.694 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:11:11.689+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:11.691165+0000) 2021-08-03T12:11:11.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:11.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:11.717625+0000) 2021-08-03T12:11:12.029 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:12.025+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:12.027176+0000) 2021-08-03T12:11:12.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:12.715+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:12.717771+0000) 2021-08-03T12:11:13.030 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:13.026+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:13.028077+0000) 2021-08-03T12:11:13.166 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:13.164+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:13.165553+0000) 2021-08-03T12:11:13.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:13.716+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:13.717910+0000) 2021-08-03T12:11:14.031 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:14.027+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:14.029419+0000) 2021-08-03T12:11:14.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:14.040+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:14.041291+0000) 2021-08-03T12:11:14.319 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:14.317+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:14.318694+0000) 2021-08-03T12:11:14.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:14.717+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:14.718032+0000) 2021-08-03T12:11:15.032 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:15.029+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:15.030338+0000) 2021-08-03T12:11:15.124 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:15.121+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:15.122739+0000) 2021-08-03T12:11:15.147 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:15.100+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4704 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:15.319 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:15.317+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:15.318858+0000) 2021-08-03T12:11:15.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:15.717+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:15.718173+0000) 2021-08-03T12:11:16.033 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:16.030+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:16.031279+0000) 2021-08-03T12:11:16.124 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:16.122+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:16.123469+0000) 2021-08-03T12:11:16.253 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:11:16.250+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:16.251040+0000) 2021-08-03T12:11:16.258 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:15.797+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5982 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:16.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:16.436+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:16.437758+0000) 2021-08-03T12:11:16.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:16.717+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:16.718307+0000) 2021-08-03T12:11:17.034 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:11:16.679+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2630 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:11:17.035 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:17.031+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:17.032400+0000) 2021-08-03T12:11:17.253 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:11:17.250+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:17.251700+0000) 2021-08-03T12:11:17.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:17.717+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:17.718519+0000) 2021-08-03T12:11:18.035 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:18.032+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:18.033520+0000) 2021-08-03T12:11:18.573 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:11:18.569+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:18.570690+0000) 2021-08-03T12:11:18.589 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:18.588+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:18.589206+0000) 2021-08-03T12:11:18.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:18.717+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:18.718688+0000) 2021-08-03T12:11:18.961 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:11:18.958+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:18.959284+0000) 2021-08-03T12:11:19.036 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:19.033+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:19.034476+0000) 2021-08-03T12:11:19.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:19.394+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:19.395249+0000) 2021-08-03T12:11:19.527 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:11:19.524+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:19.525322+0000) 2021-08-03T12:11:19.819 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:19.817+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:19.818542+0000) 2021-08-03T12:11:20.037 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:20.034+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:20.035407+0000) 2021-08-03T12:11:20.552 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:20.550+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:20.551467+0000) 2021-08-03T12:11:21.038 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:21.035+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:21.036309+0000) 2021-08-03T12:11:21.310 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:21.256+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5992 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:21.340 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:21.337+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4743 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:21.349 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:21.347+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:21.348172+0000) 2021-08-03T12:11:21.617 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:21.613+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:21.614418+0000) 2021-08-03T12:11:22.039 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:22.036+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:22.037414+0000) 2021-08-03T12:11:22.350 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:22.348+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:22.348949+0000) 2021-08-03T12:11:23.040 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:23.037+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:23.038505+0000) 2021-08-03T12:11:23.288 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:23.286+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:23.286824+0000) 2021-08-03T12:11:23.350 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:23.348+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:23.349518+0000) 2021-08-03T12:11:23.563 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:23.561+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:23.562682+0000) 2021-08-03T12:11:24.041 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:24.038+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:24.039638+0000) 2021-08-03T12:11:24.161 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:24.159+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:24.160243+0000) 2021-08-03T12:11:24.351 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:24.349+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:24.350461+0000) 2021-08-03T12:11:25.020 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:11:24.863+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2630 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:11:25.042 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:25.039+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:25.040588+0000) 2021-08-03T12:11:25.291 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:25.289+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:25.290468+0000) 2021-08-03T12:11:25.352 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:25.350+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:25.351308+0000) 2021-08-03T12:11:26.044 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:26.041+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:26.041851+0000) 2021-08-03T12:11:26.311 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:11:26.307+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:26.308135+0000) 2021-08-03T12:11:26.353 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:26.351+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:26.351926+0000) 2021-08-03T12:11:26.741 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:26.494+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5994 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:26.901 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:26.899+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:26.900337+0000) 2021-08-03T12:11:27.045 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:27.042+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:27.043214+0000) 2021-08-03T12:11:27.254 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:27.251+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:27.252893+0000) 2021-08-03T12:11:27.353 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:27.350+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:27.352756+0000) 2021-08-03T12:11:28.046 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:28.043+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:28.044479+0000) 2021-08-03T12:11:28.354 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:28.351+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:28.353376+0000) 2021-08-03T12:11:28.527 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:28.508+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4757 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:29.048 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:29.044+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:29.045587+0000) 2021-08-03T12:11:29.355 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:29.352+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:29.354007+0000) 2021-08-03T12:11:29.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:29.650+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:29.652628+0000) 2021-08-03T12:11:29.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:29.968+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:29.969162+0000) 2021-08-03T12:11:30.049 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:30.045+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:30.046481+0000) 2021-08-03T12:11:30.356 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:30.353+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:30.354815+0000) 2021-08-03T12:11:30.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:30.650+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:30.652776+0000) 2021-08-03T12:11:30.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:30.968+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:30.969265+0000) 2021-08-03T12:11:31.049 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:31.046+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:31.047329+0000) 2021-08-03T12:11:31.358 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:31.353+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:31.355443+0000) 2021-08-03T12:11:31.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:31.651+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:31.652938+0000) 2021-08-03T12:11:31.893 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:11:31.810+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2632 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:11:31.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:31.968+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:31.969396+0000) 2021-08-03T12:11:32.050 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:32.047+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:32.048712+0000) 2021-08-03T12:11:32.117 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T12:11:32.115+0000 7f57d4fe3700 0 -- 172.21.15.3:0/3813029560 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f57b00075e0 msgr2=0x7f57b0003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-03T12:11:32.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:32.624+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:32.625666+0000) 2021-08-03T12:11:32.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:32.651+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:32.653060+0000) 2021-08-03T12:11:32.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:32.968+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:32.969531+0000) 2021-08-03T12:11:33.051 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:33.048+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:33.049703+0000) 2021-08-03T12:11:33.178 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:11:33.174+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:33.176186+0000) 2021-08-03T12:11:33.503 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:11:33.499+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:33.501022+0000) 2021-08-03T12:11:33.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:33.625+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:33.625855+0000) 2021-08-03T12:11:33.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:33.651+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:33.653203+0000) 2021-08-03T12:11:33.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:33.968+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:33.969659+0000) 2021-08-03T12:11:34.052 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:34.049+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:34.050611+0000) 2021-08-03T12:11:34.345 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:34.124+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 5994 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:34.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:34.625+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:34.625969+0000) 2021-08-03T12:11:34.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:34.652+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:34.653338+0000) 2021-08-03T12:11:34.873 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:34.871+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:34.872208+0000) 2021-08-03T12:11:34.971 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:34.968+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:34.969790+0000) 2021-08-03T12:11:35.053 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:35.050+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:35.051567+0000) 2021-08-03T12:11:35.204 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:35.201+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:35.202116+0000) 2021-08-03T12:11:35.417 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:35.384+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:35.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:35.625+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:35.626101+0000) 2021-08-03T12:11:35.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:35.652+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:35.653463+0000) 2021-08-03T12:11:35.971 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:35.969+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:35.969953+0000) 2021-08-03T12:11:36.054 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:36.051+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:36.052457+0000) 2021-08-03T12:11:36.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:36.625+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:36.626224+0000) 2021-08-03T12:11:36.654 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:36.652+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:36.653598+0000) 2021-08-03T12:11:36.748 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:11:36.744+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:36.745193+0000) 2021-08-03T12:11:36.971 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:36.969+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:36.970088+0000) 2021-08-03T12:11:37.055 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:37.052+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:37.053311+0000) 2021-08-03T12:11:37.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:37.127+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:37.128548+0000) 2021-08-03T12:11:38.056 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:38.053+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:38.054200+0000) 2021-08-03T12:11:38.383 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:38.380+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:38.381711+0000) 2021-08-03T12:11:38.384 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:38.381+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:38.382247+0000) 2021-08-03T12:11:38.394 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:11:38.284+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2640 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:11:39.057 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:39.054+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:39.055047+0000) 2021-08-03T12:11:39.383 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:39.381+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:39.382401+0000) 2021-08-03T12:11:39.595 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T12:11:39.594+0000 7f57d4fe3700 0 --2- 172.21.15.3:0/3813029560 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f57b00075e0 0x7f57b0003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2021-08-03T12:11:39.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:39.793+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:39.794672+0000) 2021-08-03T12:11:40.058 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:40.055+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:40.055944+0000) 2021-08-03T12:11:40.387 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:40.385+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:40.386625+0000) 2021-08-03T12:11:40.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:40.794+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:40.794828+0000) 2021-08-03T12:11:41.040 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:11:41.037+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:41.038473+0000) 2021-08-03T12:11:41.058 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:41.056+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:41.056900+0000) 2021-08-03T12:11:41.388 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:41.386+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:41.387255+0000) 2021-08-03T12:11:41.518 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:41.408+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6003 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:41.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:41.794+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:41.794948+0000) 2021-08-03T12:11:42.059 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:42.057+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:42.057982+0000) 2021-08-03T12:11:42.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:42.231+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:42.232449+0000) 2021-08-03T12:11:42.390 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:42.387+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:42.388392+0000) 2021-08-03T12:11:42.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:42.794+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:42.795114+0000) 2021-08-03T12:11:43.061 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:43.058+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:43.059152+0000) 2021-08-03T12:11:43.390 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:43.388+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:43.388957+0000) 2021-08-03T12:11:43.561 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:43.558+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:43.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:43.794+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:43.795244+0000) 2021-08-03T12:11:43.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:43.816+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:43.817704+0000) 2021-08-03T12:11:44.062 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:44.059+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:44.060228+0000) 2021-08-03T12:11:44.391 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:44.389+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:44.389807+0000) 2021-08-03T12:11:44.536 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:44.532+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:44.533508+0000) 2021-08-03T12:11:44.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:44.719+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:44.720478+0000) 2021-08-03T12:11:44.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:44.794+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:44.795369+0000) 2021-08-03T12:11:44.904 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:44.903+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:44.904355+0000) 2021-08-03T12:11:45.063 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:45.060+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:45.061118+0000) 2021-08-03T12:11:45.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:45.719+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:45.720633+0000) 2021-08-03T12:11:45.784 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:11:45.781+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:45.782224+0000) 2021-08-03T12:11:45.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:45.794+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:45.795487+0000) 2021-08-03T12:11:45.915 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:45.913+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:45.914022+0000) 2021-08-03T12:11:45.997 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:45.994+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:45.995058+0000) 2021-08-03T12:11:46.064 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:46.061+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:46.061997+0000) 2021-08-03T12:11:46.403 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:11:46.400+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:46.400857+0000) 2021-08-03T12:11:46.547 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:46.545+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:46.546083+0000) 2021-08-03T12:11:46.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:46.719+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:46.720760+0000) 2021-08-03T12:11:46.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:46.794+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:46.795605+0000) 2021-08-03T12:11:46.998 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:46.995+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:46.995746+0000) 2021-08-03T12:11:47.064 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:47.062+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:47.062962+0000) 2021-08-03T12:11:47.548 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:11:47.546+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:47.547304+0000) 2021-08-03T12:11:47.679 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:11:47.675+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2646 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:11:47.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:47.720+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:47.720909+0000) 2021-08-03T12:11:47.998 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:47.995+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:47.996316+0000) 2021-08-03T12:11:48.065 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:48.063+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:48.063900+0000) 2021-08-03T12:11:48.420 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:11:48.416+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:48.417727+0000) 2021-08-03T12:11:48.453 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:48.419+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6003 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:48.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:48.720+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:48.721090+0000) 2021-08-03T12:11:48.998 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:48.996+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:48.996879+0000) 2021-08-03T12:11:49.066 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:49.064+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:49.064774+0000) 2021-08-03T12:11:49.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:49.720+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:49.721239+0000) 2021-08-03T12:11:50.007 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:49.996+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:49.997422+0000) 2021-08-03T12:11:50.068 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:50.064+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:50.065719+0000) 2021-08-03T12:11:50.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:50.720+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:50.721385+0000) 2021-08-03T12:11:50.987 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:50.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:50.987391+0000) 2021-08-03T12:11:51.000 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:50.997+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:50.997981+0000) 2021-08-03T12:11:51.068 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:51.065+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:51.066700+0000) 2021-08-03T12:11:51.134 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:51.130+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:51.632 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:11:51.630+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:51.630931+0000) 2021-08-03T12:11:51.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:51.720+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:51.721528+0000) 2021-08-03T12:11:51.988 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:51.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:51.987542+0000) 2021-08-03T12:11:52.000 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:51.997+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:51.998616+0000) 2021-08-03T12:11:52.069 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:52.067+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:52.067804+0000) 2021-08-03T12:11:52.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:52.720+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:52.721663+0000) 2021-08-03T12:11:52.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:52.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:52.814081+0000) 2021-08-03T12:11:52.926 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:52.923+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:52.923783+0000) 2021-08-03T12:11:52.988 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:52.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:52.987682+0000) 2021-08-03T12:11:53.000 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:52.998+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:52.999174+0000) 2021-08-03T12:11:53.070 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:53.068+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:53.068857+0000) 2021-08-03T12:11:53.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:53.721+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:53.721821+0000) 2021-08-03T12:11:53.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:53.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:53.814215+0000) 2021-08-03T12:11:53.988 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:53.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:53.987820+0000) 2021-08-03T12:11:54.001 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:53.999+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:53.999737+0000) 2021-08-03T12:11:54.072 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:54.069+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:54.069949+0000) 2021-08-03T12:11:54.388 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:11:53.773+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6003 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:11:54.633 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:54.630+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:54.632536+0000) 2021-08-03T12:11:54.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:54.812+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:54.814384+0000) 2021-08-03T12:11:54.983 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:11:54.953+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2648 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:11:54.988 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:54.987+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:54.987960+0000) 2021-08-03T12:11:55.002 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:54.998+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:55.000294+0000) 2021-08-03T12:11:55.073 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:55.069+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:55.071294+0000) 2021-08-03T12:11:55.521 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:55.519+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:55.520023+0000) 2021-08-03T12:11:55.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:55.812+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:55.814538+0000) 2021-08-03T12:11:55.889 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:11:55.885+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:55.886054+0000) 2021-08-03T12:11:55.988 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:55.987+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:55.988079+0000) 2021-08-03T12:11:56.003 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:55.999+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:56.000862+0000) 2021-08-03T12:11:56.074 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:56.070+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:56.072441+0000) 2021-08-03T12:11:56.522 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:56.520+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:56.521010+0000) 2021-08-03T12:11:56.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:56.812+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:56.814668+0000) 2021-08-03T12:11:56.988 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:11:56.987+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:56.988209+0000) 2021-08-03T12:11:57.003 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:11:57.000+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:57.001820+0000) 2021-08-03T12:11:57.075 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:57.071+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:57.073310+0000) 2021-08-03T12:11:57.099 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:11:57.081+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:11:57.522 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:57.520+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:57.521589+0000) 2021-08-03T12:11:57.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:57.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:57.814834+0000) 2021-08-03T12:11:58.076 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:58.072+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:58.074231+0000) 2021-08-03T12:11:58.523 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:11:58.521+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:58.522159+0000) 2021-08-03T12:11:58.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:58.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:58.814988+0000) 2021-08-03T12:11:59.077 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:11:59.073+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:59.075134+0000) 2021-08-03T12:11:59.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:11:59.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:11:59.815128+0000) 2021-08-03T12:12:00.077 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:00.074+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:00.075999+0000) 2021-08-03T12:12:00.178 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:00.175+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:00.177072+0000) 2021-08-03T12:12:00.301 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:00.298+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:00.300234+0000) 2021-08-03T12:12:00.373 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:00.302+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6003 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:00.679 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:00.678+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:00.679450+0000) 2021-08-03T12:12:00.711 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:00.707+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2650 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:00.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:00.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:00.815280+0000) 2021-08-03T12:12:01.079 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:01.075+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:01.076947+0000) 2021-08-03T12:12:01.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:01.470+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:01.472176+0000) 2021-08-03T12:12:01.718 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:01.714+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:01.716024+0000) 2021-08-03T12:12:01.777 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:01.772+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:01.774389+0000) 2021-08-03T12:12:01.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:01.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:01.815394+0000) 2021-08-03T12:12:02.080 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:02.076+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:02.078026+0000) 2021-08-03T12:12:02.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:02.470+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:02.472341+0000) 2021-08-03T12:12:02.555 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:02.551+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:02.553153+0000) 2021-08-03T12:12:02.617 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:02.614+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:02.615738+0000) 2021-08-03T12:12:02.786 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:02.782+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:02.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:02.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:02.815512+0000) 2021-08-03T12:12:03.081 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:03.078+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:03.078993+0000) 2021-08-03T12:12:03.245 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:03.243+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:03.243858+0000) 2021-08-03T12:12:03.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:03.470+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:03.472494+0000) 2021-08-03T12:12:03.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:03.814+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:03.815680+0000) 2021-08-03T12:12:04.082 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:04.079+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:04.079891+0000) 2021-08-03T12:12:04.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:04.471+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:04.472641+0000) 2021-08-03T12:12:04.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:04.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:04.815821+0000) 2021-08-03T12:12:04.825 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:04.822+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:04.823353+0000) 2021-08-03T12:12:04.955 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:04.952+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:04.953750+0000) 2021-08-03T12:12:05.082 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:05.080+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:05.080785+0000) 2021-08-03T12:12:05.301 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T12:12:05.298+0000 7f57d5fe5700 0 -- 172.21.15.3:0/3813029560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b00043f0 msgr2=0x7f57b4020f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-03T12:12:05.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:05.471+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:05.472794+0000) 2021-08-03T12:12:05.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:05.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:05.815936+0000) 2021-08-03T12:12:05.826 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:05.823+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:05.824091+0000) 2021-08-03T12:12:06.054 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:06.049+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:06.050628+0000) 2021-08-03T12:12:06.082 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:06.080+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:06.081304+0000) 2021-08-03T12:12:06.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:06.472+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:06.472912+0000) 2021-08-03T12:12:06.630 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:06.280+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6003 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:06.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:06.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:06.816045+0000) 2021-08-03T12:12:07.075 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:07.073+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:07.073979+0000) 2021-08-03T12:12:07.083 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:07.080+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:07.081682+0000) 2021-08-03T12:12:07.425 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:07.423+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:07.423902+0000) 2021-08-03T12:12:07.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:07.472+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:07.473010+0000) 2021-08-03T12:12:07.670 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:12:07.666+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:07.667742+0000) 2021-08-03T12:12:07.765 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:07.761+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2671 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:07.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:07.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:07.816184+0000) 2021-08-03T12:12:07.988 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:07.984+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:07.985381+0000) 2021-08-03T12:12:08.085 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:08.081+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:08.082658+0000) 2021-08-03T12:12:08.469 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:08.465+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:08.466308+0000) 2021-08-03T12:12:08.600 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:08.595+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:08.596402+0000) 2021-08-03T12:12:08.728 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:08.726+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:08.726985+0000) 2021-08-03T12:12:08.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:08.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:08.816318+0000) 2021-08-03T12:12:08.973 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:08.970+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:08.971461+0000) 2021-08-03T12:12:09.085 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:09.082+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:09.083427+0000) 2021-08-03T12:12:09.555 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:09.520+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:09.562 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:09.560+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:09.561201+0000) 2021-08-03T12:12:09.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:09.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:09.816458+0000) 2021-08-03T12:12:10.086 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:10.083+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:10.083931+0000) 2021-08-03T12:12:10.731 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:10.728+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:10.729491+0000) 2021-08-03T12:12:10.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:10.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:10.816582+0000) 2021-08-03T12:12:11.086 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:11.083+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:11.084515+0000) 2021-08-03T12:12:11.164 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:11.161+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:11.162735+0000) 2021-08-03T12:12:11.322 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:11.321+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:11.321928+0000) 2021-08-03T12:12:11.715 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:11.462+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6006 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:11.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:11.815+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:11.816708+0000) 2021-08-03T12:12:12.088 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:12.085+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:12.086488+0000) 2021-08-03T12:12:12.413 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:12:12.411+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:12.412063+0000) 2021-08-03T12:12:12.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:12.816+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:12.816862+0000) 2021-08-03T12:12:13.376 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:13.374+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:13.375362+0000) 2021-08-03T12:12:14.226 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:14.224+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:14.225127+0000) 2021-08-03T12:12:14.346 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:14.345+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:14.346382+0000) 2021-08-03T12:12:15.080 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:15.019+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2679 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:15.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:15.222+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:15.223405+0000) 2021-08-03T12:12:15.227 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:15.226+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:15.226863+0000) 2021-08-03T12:12:15.501 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:15.497+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:15.498560+0000) 2021-08-03T12:12:16.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:16.222+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:16.223555+0000) 2021-08-03T12:12:16.229 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:16.227+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:16.227883+0000) 2021-08-03T12:12:16.892 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:16.551+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:17.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:17.222+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:17.223707+0000) 2021-08-03T12:12:17.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:17.785+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:17.786009+0000) 2021-08-03T12:12:18.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:18.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:18.223866+0000) 2021-08-03T12:12:18.275 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:18.193+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6024 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:18.769 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:18.765+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:18.766010+0000) 2021-08-03T12:12:18.952 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:18.950+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:18.950920+0000) 2021-08-03T12:12:19.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:19.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:19.223974+0000) 2021-08-03T12:12:19.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:19.566+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:19.567105+0000) 2021-08-03T12:12:20.205 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:20.202+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:20.202782+0000) 2021-08-03T12:12:20.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:20.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:20.224092+0000) 2021-08-03T12:12:20.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:20.566+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:20.567223+0000) 2021-08-03T12:12:21.180 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:12:21.177+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:21.178746+0000) 2021-08-03T12:12:21.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:21.182+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:21.183455+0000) 2021-08-03T12:12:21.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:21.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:21.224215+0000) 2021-08-03T12:12:21.320 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:21.160+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2688 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:21.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:21.566+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:21.567368+0000) 2021-08-03T12:12:22.111 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:22.109+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:22.110368+0000) 2021-08-03T12:12:22.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:22.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:22.224369+0000) 2021-08-03T12:12:22.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:22.566+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:22.567517+0000) 2021-08-03T12:12:22.803 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:22.772+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:23.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:23.566+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:23.567663+0000) 2021-08-03T12:12:23.775 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:12:23.772+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:23.773227+0000) 2021-08-03T12:12:24.983 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:24.877+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6026 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:25.067 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:25.065+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:25.065936+0000) 2021-08-03T12:12:25.656 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:25.654+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:25.655675+0000) 2021-08-03T12:12:25.917 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:25.913+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:25.913882+0000) 2021-08-03T12:12:26.526 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:26.523+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:26.524395+0000) 2021-08-03T12:12:26.656 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:26.654+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:26.655821+0000) 2021-08-03T12:12:27.526 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:27.524+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:27.525072+0000) 2021-08-03T12:12:27.656 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:27.655+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:27.655951+0000) 2021-08-03T12:12:28.095 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:28.092+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:28.093648+0000) 2021-08-03T12:12:28.145 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:28.142+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:28.143179+0000) 2021-08-03T12:12:28.527 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:28.524+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:28.525636+0000) 2021-08-03T12:12:28.656 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:28.655+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:28.656109+0000) 2021-08-03T12:12:28.874 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:28.871+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:28.872764+0000) 2021-08-03T12:12:29.096 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:29.093+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:29.094363+0000) 2021-08-03T12:12:29.527 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:29.525+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:29.526447+0000) 2021-08-03T12:12:29.534 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:29.531+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:29.532021+0000) 2021-08-03T12:12:29.615 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:29.608+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:29.608775+0000) 2021-08-03T12:12:29.656 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:29.655+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:29.656251+0000) 2021-08-03T12:12:29.975 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:29.973+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:29.974781+0000) 2021-08-03T12:12:30.097 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:30.094+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:30.095206+0000) 2021-08-03T12:12:30.160 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:29.534+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2696 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:30.241 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:30.238+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:30.239165+0000) 2021-08-03T12:12:30.305 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:30.087+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:30.375 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:30.304+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6026 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:30.530 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:30.527+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:30.528524+0000) 2021-08-03T12:12:31.097 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:31.095+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:31.095840+0000) 2021-08-03T12:12:31.319 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:31.317+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:31.318057+0000) 2021-08-03T12:12:31.530 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:31.528+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:31.529354+0000) 2021-08-03T12:12:31.602 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:12:31.598+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:31.599269+0000) 2021-08-03T12:12:32.098 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:32.095+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:32.096588+0000) 2021-08-03T12:12:32.279 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:32.276+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:32.276781+0000) 2021-08-03T12:12:32.531 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:32.529+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:32.529903+0000) 2021-08-03T12:12:33.099 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:33.096+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:33.097190+0000) 2021-08-03T12:12:33.320 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:33.318+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:33.319416+0000) 2021-08-03T12:12:33.531 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:33.529+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:33.530459+0000) 2021-08-03T12:12:34.099 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:34.097+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:34.097972+0000) 2021-08-03T12:12:34.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:34.355+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:34.356469+0000) 2021-08-03T12:12:34.532 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:34.530+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:34.531013+0000) 2021-08-03T12:12:35.100 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:35.097+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:35.098569+0000) 2021-08-03T12:12:35.307 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:35.226+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:35.533 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:35.529+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:35.531662+0000) 2021-08-03T12:12:36.101 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:36.098+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:36.099531+0000) 2021-08-03T12:12:36.533 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:36.530+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:36.532314+0000) 2021-08-03T12:12:36.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:36.636+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:36.637468+0000) 2021-08-03T12:12:37.102 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:37.099+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:37.100090+0000) 2021-08-03T12:12:37.156 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:37.151+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:37.152111+0000) 2021-08-03T12:12:37.534 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:37.531+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:37.533052+0000) 2021-08-03T12:12:37.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:37.724+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:37.725155+0000) 2021-08-03T12:12:37.873 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:37.870+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:37.871278+0000) 2021-08-03T12:12:38.104 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:38.099+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:38.100701+0000) 2021-08-03T12:12:38.524 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:38.520+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:38.521569+0000) 2021-08-03T12:12:38.534 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:38.531+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:38.533641+0000) 2021-08-03T12:12:38.603 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:38.501+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6064 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:38.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:38.724+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:38.725318+0000) 2021-08-03T12:12:39.535 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:39.532+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:39.534445+0000) 2021-08-03T12:12:39.672 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:39.538+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2701 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:40.273 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:40.270+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:40.271894+0000) 2021-08-03T12:12:40.536 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:40.533+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:40.535189+0000) 2021-08-03T12:12:41.044 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:41.040+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:41.041618+0000) 2021-08-03T12:12:41.537 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:41.534+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:41.535800+0000) 2021-08-03T12:12:41.543 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:41.539+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:41.541355+0000) 2021-08-03T12:12:42.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:42.442+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:42.443421+0000) 2021-08-03T12:12:42.878 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:42.875+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4780 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:42.950 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:12:42.948+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:42.949203+0000) 2021-08-03T12:12:43.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:43.449+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:43.450759+0000) 2021-08-03T12:12:44.187 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:44.184+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:44.185957+0000) 2021-08-03T12:12:44.600 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:44.596+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:44.597017+0000) 2021-08-03T12:12:44.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:44.740+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:44.742179+0000) 2021-08-03T12:12:45.132 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:45.128+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:45.130341+0000) 2021-08-03T12:12:45.161 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:45.157+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:45.159639+0000) 2021-08-03T12:12:45.650 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:12:45.648+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:45.649664+0000) 2021-08-03T12:12:46.162 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:46.158+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:46.160364+0000) 2021-08-03T12:12:46.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:46.395+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:46.397783+0000) 2021-08-03T12:12:46.813 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:46.771+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6087 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:47.635 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:47.632+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:47.633431+0000) 2021-08-03T12:12:47.839 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:47.835+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:47.836781+0000) 2021-08-03T12:12:47.873 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:12:47.870+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:47.871765+0000) 2021-08-03T12:12:48.010 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:48.006+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:48.007944+0000) 2021-08-03T12:12:48.214 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:12:48.210+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:48.212194+0000) 2021-08-03T12:12:48.508 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:48.504+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:48.506022+0000) 2021-08-03T12:12:48.561 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:48.558+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:48.559780+0000) 2021-08-03T12:12:48.635 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:48.633+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:48.634153+0000) 2021-08-03T12:12:48.982 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:48.722+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2701 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:49.010 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:49.006+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:49.008655+0000) 2021-08-03T12:12:49.635 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:49.633+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:49.634735+0000) 2021-08-03T12:12:49.853 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:49.848+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:49.850711+0000) 2021-08-03T12:12:50.012 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:50.008+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:50.009797+0000) 2021-08-03T12:12:50.852 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:50.849+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:50.850849+0000) 2021-08-03T12:12:50.953 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:50.949+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:50.950191+0000) 2021-08-03T12:12:51.111 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:50.861+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4782 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:51.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:51.406+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:51.408565+0000) 2021-08-03T12:12:51.825 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:51.822+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:51.824663+0000) 2021-08-03T12:12:51.852 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:51.849+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:51.850968+0000) 2021-08-03T12:12:52.852 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:52.850+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:52.851131+0000) 2021-08-03T12:12:52.981 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:12:52.977+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:52.977921+0000) 2021-08-03T12:12:53.396 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:53.393+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:53.394663+0000) 2021-08-03T12:12:53.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:53.568+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:53.568874+0000) 2021-08-03T12:12:53.852 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:53.850+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:53.851268+0000) 2021-08-03T12:12:54.397 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:54.394+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:54.395482+0000) 2021-08-03T12:12:54.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:54.568+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:54.569023+0000) 2021-08-03T12:12:54.617 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:12:54.458+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6104 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:12:54.852 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:54.850+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:54.851400+0000) 2021-08-03T12:12:55.240 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:12:55.033+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2705 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:12:55.398 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:55.395+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:55.396162+0000) 2021-08-03T12:12:55.853 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:55.850+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:55.851534+0000) 2021-08-03T12:12:56.398 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:56.396+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:56.396732+0000) 2021-08-03T12:12:56.853 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:56.850+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:56.851671+0000) 2021-08-03T12:12:57.029 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:12:57.026+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:57.026813+0000) 2021-08-03T12:12:57.399 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:57.396+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:57.397341+0000) 2021-08-03T12:12:57.624 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:57.622+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:57.623687+0000) 2021-08-03T12:12:57.918 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:57.915+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:57.915788+0000) 2021-08-03T12:12:57.993 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:12:57.915+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:12:58.106 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:58.104+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:58.105097+0000) 2021-08-03T12:12:58.399 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:58.397+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:58.397939+0000) 2021-08-03T12:12:58.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:58.410+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:58.411621+0000) 2021-08-03T12:12:58.551 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:12:58.549+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:58.550140+0000) 2021-08-03T12:12:58.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:58.608+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:58.609327+0000) 2021-08-03T12:12:58.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:58.625+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:58.626274+0000) 2021-08-03T12:12:59.107 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:12:59.104+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:59.105706+0000) 2021-08-03T12:12:59.400 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:12:59.397+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:59.398690+0000) 2021-08-03T12:12:59.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:12:59.626+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:59.626999+0000) 2021-08-03T12:12:59.711 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:12:59.709+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:12:59.710097+0000) 2021-08-03T12:13:00.114 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:00.111+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:00.111910+0000) 2021-08-03T12:13:00.401 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:00.398+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:00.399230+0000) 2021-08-03T12:13:00.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:00.626+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:00.627183+0000) 2021-08-03T12:13:01.114 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:01.111+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:01.112697+0000) 2021-08-03T12:13:01.401 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:01.399+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:01.399797+0000) 2021-08-03T12:13:01.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:01.626+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:01.627306+0000) 2021-08-03T12:13:01.890 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:01.886+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:01.887324+0000) 2021-08-03T12:13:02.115 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:02.112+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:02.113555+0000) 2021-08-03T12:13:02.353 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:02.350+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:02.351164+0000) 2021-08-03T12:13:02.402 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:02.399+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:02.400349+0000) 2021-08-03T12:13:02.949 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:02.946+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6113 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:03.116 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:03.113+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:03.114151+0000) 2021-08-03T12:13:03.172 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:02.736+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2707 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:03.259 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:03.255+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:03.256045+0000) 2021-08-03T12:13:03.354 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:03.351+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:03.351933+0000) 2021-08-03T12:13:03.404 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:03.400+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:03.401215+0000) 2021-08-03T12:13:03.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:03.566+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:03.567465+0000) 2021-08-03T12:13:03.862 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:03.860+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:03.861626+0000) 2021-08-03T12:13:03.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:03.989+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:03.990643+0000) 2021-08-03T12:13:04.354 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:04.351+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:04.352677+0000) 2021-08-03T12:13:04.403 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:04.401+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:04.401940+0000) 2021-08-03T12:13:04.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:04.434+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:04.435425+0000) 2021-08-03T12:13:04.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:04.989+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:04.990797+0000) 2021-08-03T12:13:05.355 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:05.352+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:05.353238+0000) 2021-08-03T12:13:05.404 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:05.401+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:05.402484+0000) 2021-08-03T12:13:05.558 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:05.435+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4784 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:05.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:05.646+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:05.646835+0000) 2021-08-03T12:13:05.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:05.693+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:05.694378+0000) 2021-08-03T12:13:05.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:05.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:05.990917+0000) 2021-08-03T12:13:06.355 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:06.353+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:06.353998+0000) 2021-08-03T12:13:06.405 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:06.402+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:06.403159+0000) 2021-08-03T12:13:06.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:06.693+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:06.694480+0000) 2021-08-03T12:13:06.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:06.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:06.991045+0000) 2021-08-03T12:13:07.356 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:07.353+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:07.354579+0000) 2021-08-03T12:13:07.668 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:07.665+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:07.665893+0000) 2021-08-03T12:13:07.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:07.693+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:07.694639+0000) 2021-08-03T12:13:07.978 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:07.976+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:07.977014+0000) 2021-08-03T12:13:07.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:07.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:07.991168+0000) 2021-08-03T12:13:08.010 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:08.008+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:08.009588+0000) 2021-08-03T12:13:08.186 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:08.182+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:08.183511+0000) 2021-08-03T12:13:08.357 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:08.354+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:08.355560+0000) 2021-08-03T12:13:08.537 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:08.477+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6115 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:08.978 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:08.976+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:08.977147+0000) 2021-08-03T12:13:08.992 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:08.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:08.991301+0000) 2021-08-03T12:13:09.028 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:09.022+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:09.023617+0000) 2021-08-03T12:13:09.358 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:09.355+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:09.356108+0000) 2021-08-03T12:13:09.549 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:09.547+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:09.548115+0000) 2021-08-03T12:13:09.978 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:09.976+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:09.977252+0000) 2021-08-03T12:13:09.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:09.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:09.991427+0000) 2021-08-03T12:13:10.292 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:09.650+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2707 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:10.358 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:10.355+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:10.356689+0000) 2021-08-03T12:13:10.471 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:10.469+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:10.469857+0000) 2021-08-03T12:13:10.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:10.734+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:10.735259+0000) 2021-08-03T12:13:10.978 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:10.976+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:10.977373+0000) 2021-08-03T12:13:10.990 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:10.955+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4787 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:10.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:10.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:10.991557+0000) 2021-08-03T12:13:11.359 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:11.356+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:11.357293+0000) 2021-08-03T12:13:11.369 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:11.366+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:11.366862+0000) 2021-08-03T12:13:11.472 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:11.469+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:11.470563+0000) 2021-08-03T12:13:11.992 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:11.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:11.991692+0000) 2021-08-03T12:13:12.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:12.247+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:12.248339+0000) 2021-08-03T12:13:12.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:12.468+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:12.469642+0000) 2021-08-03T12:13:12.472 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:12.470+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:12.471158+0000) 2021-08-03T12:13:12.992 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:12.990+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:12.991831+0000) 2021-08-03T12:13:13.420 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:13.418+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:13.419441+0000) 2021-08-03T12:13:13.473 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:13.471+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:13.471935+0000) 2021-08-03T12:13:13.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:13.746+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:13.747376+0000) 2021-08-03T12:13:13.992 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:13.991+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:13.991969+0000) 2021-08-03T12:13:14.421 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:14.419+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:14.420202+0000) 2021-08-03T12:13:14.473 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:14.471+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:14.472526+0000) 2021-08-03T12:13:15.422 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:15.420+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:15.421022+0000) 2021-08-03T12:13:15.474 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:15.473+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:15.473832+0000) 2021-08-03T12:13:15.622 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:15.621+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:15.622083+0000) 2021-08-03T12:13:15.809 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:15.806+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:15.806863+0000) 2021-08-03T12:13:16.422 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:16.421+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:16.421850+0000) 2021-08-03T12:13:16.454 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:16.451+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:16.451856+0000) 2021-08-03T12:13:16.476 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:16.474+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:16.475305+0000) 2021-08-03T12:13:16.529 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:16.447+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6124 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:17.242 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:17.240+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:17.241345+0000) 2021-08-03T12:13:17.264 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:17.262+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:17.262964+0000) 2021-08-03T12:13:17.265 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:17.263+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:17.264419+0000) 2021-08-03T12:13:17.423 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:17.421+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:17.422437+0000) 2021-08-03T12:13:17.476 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:17.475+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:17.475834+0000) 2021-08-03T12:13:17.598 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:17.594+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:17.595682+0000) 2021-08-03T12:13:17.744 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:17.611+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4807 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:17.840 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:17.838+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:17.839569+0000) 2021-08-03T12:13:18.243 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:18.241+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:18.242095+0000) 2021-08-03T12:13:18.426 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:18.422+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:18.423234+0000) 2021-08-03T12:13:18.478 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:18.476+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:18.476827+0000) 2021-08-03T12:13:18.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:18.819+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:18.820062+0000) 2021-08-03T12:13:18.857 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:18.853+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:18.854304+0000) 2021-08-03T12:13:19.249 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:19.241+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:19.242743+0000) 2021-08-03T12:13:19.425 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:19.422+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:19.423758+0000) 2021-08-03T12:13:19.483 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:19.476+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:19.477412+0000) 2021-08-03T12:13:19.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:19.819+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:19.820211+0000) 2021-08-03T12:13:20.208 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:19.854+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2707 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:20.482 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:20.477+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:20.477977+0000) 2021-08-03T12:13:20.515 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:20.512+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:20.513705+0000) 2021-08-03T12:13:20.823 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:20.819+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:20.820366+0000) 2021-08-03T12:13:21.016 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:21.013+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:21.013987+0000) 2021-08-03T12:13:21.183 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:21.181+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:21.181911+0000) 2021-08-03T12:13:21.422 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:21.419+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:21.420438+0000) 2021-08-03T12:13:21.515 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:21.513+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:21.514370+0000) 2021-08-03T12:13:21.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:21.819+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:21.820490+0000) 2021-08-03T12:13:22.016 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:22.013+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:22.014697+0000) 2021-08-03T12:13:22.103 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:22.101+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:22.102743+0000) 2021-08-03T12:13:22.520 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:22.514+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:22.515334+0000) 2021-08-03T12:13:22.521 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:22.482+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6133 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:22.542 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:22.539+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:22.540433+0000) 2021-08-03T12:13:22.596 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:22.593+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:22.593948+0000) 2021-08-03T12:13:22.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:22.774+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:22.774980+0000) 2021-08-03T12:13:22.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:22.819+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:22.820636+0000) 2021-08-03T12:13:23.018 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:23.014+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:23.015249+0000) 2021-08-03T12:13:23.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:23.102+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:23.102888+0000) 2021-08-03T12:13:23.337 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:23.332+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:23.333651+0000) 2021-08-03T12:13:23.517 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:23.515+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:23.516267+0000) 2021-08-03T12:13:23.597 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:23.594+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:23.594932+0000) 2021-08-03T12:13:23.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:23.749+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:23.750394+0000) 2021-08-03T12:13:23.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:23.819+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:23.820753+0000) 2021-08-03T12:13:24.018 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:24.015+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:24.016096+0000) 2021-08-03T12:13:24.031 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:24.024+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4811 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:24.096 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:24.095+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:24.096284+0000) 2021-08-03T12:13:24.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:24.102+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:24.103005+0000) 2021-08-03T12:13:24.120 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:24.117+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:24.118292+0000) 2021-08-03T12:13:24.518 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:24.516+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:24.517355+0000) 2021-08-03T12:13:24.597 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:24.594+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:24.595525+0000) 2021-08-03T12:13:24.822 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:24.820+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:24.820884+0000) 2021-08-03T12:13:25.067 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:25.064+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:25.065267+0000) 2021-08-03T12:13:25.519 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:25.517+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:25.518534+0000) 2021-08-03T12:13:25.545 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:25.542+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:25.543109+0000) 2021-08-03T12:13:25.597 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:25.595+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:25.596126+0000) 2021-08-03T12:13:25.819 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:25.696+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2707 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:25.822 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:25.820+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:25.820998+0000) 2021-08-03T12:13:26.408 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:26.405+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:26.406110+0000) 2021-08-03T12:13:26.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:26.408+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:26.409413+0000) 2021-08-03T12:13:26.598 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:26.595+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:26.596659+0000) 2021-08-03T12:13:26.645 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:26.640+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:26.640998+0000) 2021-08-03T12:13:27.325 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:27.324+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:27.325559+0000) 2021-08-03T12:13:27.599 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:27.596+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:27.597417+0000) 2021-08-03T12:13:27.998 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:27.994+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:27.995247+0000) 2021-08-03T12:13:28.326 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:28.324+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:28.325708+0000) 2021-08-03T12:13:28.600 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:28.597+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:28.598010+0000) 2021-08-03T12:13:28.823 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:28.821+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:28.822326+0000) 2021-08-03T12:13:28.996 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:28.892+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6158 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:29.567 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:29.358+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4813 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:31.062 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:31.058+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:31.059081+0000) 2021-08-03T12:13:31.121 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:31.119+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:31.120112+0000) 2021-08-03T12:13:31.974 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:31.972+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:31.973376+0000) 2021-08-03T12:13:32.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:32.627+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:32.627811+0000) 2021-08-03T12:13:33.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:33.527+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:33.529107+0000) 2021-08-03T12:13:33.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:33.628+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:33.630415+0000) 2021-08-03T12:13:33.822 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:33.574+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:34.215 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:34.210+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:34.212055+0000) 2021-08-03T12:13:34.632 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:34.629+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:34.631167+0000) 2021-08-03T12:13:35.632 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:35.629+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:35.631321+0000) 2021-08-03T12:13:36.313 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:36.311+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:36.312831+0000) 2021-08-03T12:13:36.632 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:36.629+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:36.631520+0000) 2021-08-03T12:13:36.749 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:36.746+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:36.747409+0000) 2021-08-03T12:13:36.899 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:36.874+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6185 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:36.902 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:36.898+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:36.900327+0000) 2021-08-03T12:13:36.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:36.944+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:36.946413+0000) 2021-08-03T12:13:37.043 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:37.040+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:37.041779+0000) 2021-08-03T12:13:37.237 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:37.233+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:37.234766+0000) 2021-08-03T12:13:37.632 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:37.629+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:37.631643+0000) 2021-08-03T12:13:37.928 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:37.925+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4813 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:37.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:37.944+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:37.946572+0000) 2021-08-03T12:13:38.429 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:38.426+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:38.428711+0000) 2021-08-03T12:13:38.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:38.944+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:38.946713+0000) 2021-08-03T12:13:39.720 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:39.716+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:39.718240+0000) 2021-08-03T12:13:39.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:39.945+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:39.946869+0000) 2021-08-03T12:13:40.318 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:40.316+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:40.317786+0000) 2021-08-03T12:13:40.482 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:40.480+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:40.480928+0000) 2021-08-03T12:13:40.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:40.945+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:40.947029+0000) 2021-08-03T12:13:41.109 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:41.082+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2721 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:41.125 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:41.121+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:41.123346+0000) 2021-08-03T12:13:41.141 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:41.138+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:41.139580+0000) 2021-08-03T12:13:41.482 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:41.480+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:41.481644+0000) 2021-08-03T12:13:41.624 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:41.621+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:41.623336+0000) 2021-08-03T12:13:41.643 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:41.640+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:41.642661+0000) 2021-08-03T12:13:41.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:41.946+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:41.947153+0000) 2021-08-03T12:13:42.483 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:42.481+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:42.482226+0000) 2021-08-03T12:13:42.661 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:42.658+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:42.659539+0000) 2021-08-03T12:13:42.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:42.946+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:42.947337+0000) 2021-08-03T12:13:43.214 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:43.210+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:43.212633+0000) 2021-08-03T12:13:43.334 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:43.330+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:43.331625+0000) 2021-08-03T12:13:43.483 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:43.481+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:43.482809+0000) 2021-08-03T12:13:43.660 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:43.657+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:43.659710+0000) 2021-08-03T12:13:43.799 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:43.582+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4813 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:44.011 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:44.009+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:44.010523+0000) 2021-08-03T12:13:44.216 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:44.211+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:44.213405+0000) 2021-08-03T12:13:44.484 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:44.481+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:44.483406+0000) 2021-08-03T12:13:44.660 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:44.657+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:44.659847+0000) 2021-08-03T12:13:44.791 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:44.788+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:44.788852+0000) 2021-08-03T12:13:45.141 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:45.139+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:45.140186+0000) 2021-08-03T12:13:45.209 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:45.041+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6209 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:45.791 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:45.788+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:45.789581+0000) 2021-08-03T12:13:46.618 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:46.614+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:46.616449+0000) 2021-08-03T12:13:46.792 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:46.789+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:46.790379+0000) 2021-08-03T12:13:47.653 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:47.649+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:47.650468+0000) 2021-08-03T12:13:47.792 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:47.790+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:47.790958+0000) 2021-08-03T12:13:48.694 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:13:48.691+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:48.693117+0000) 2021-08-03T12:13:48.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:48.701+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:48.703217+0000) 2021-08-03T12:13:48.793 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:48.790+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:48.791568+0000) 2021-08-03T12:13:48.968 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:13:48.963+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:48.965545+0000) 2021-08-03T12:13:49.308 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:49.306+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:49.307911+0000) 2021-08-03T12:13:49.794 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:49.791+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:49.792165+0000) 2021-08-03T12:13:50.250 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:50.247+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:50.249259+0000) 2021-08-03T12:13:50.310 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:50.307+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:50.308998+0000) 2021-08-03T12:13:50.337 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:50.334+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:50.334852+0000) 2021-08-03T12:13:50.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:50.415+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:50.416144+0000) 2021-08-03T12:13:50.595 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:50.541+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2732 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:50.775 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:50.681+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4813 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:50.794 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:50.792+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:50.792763+0000) 2021-08-03T12:13:50.825 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:50.807+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6217 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:51.252 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:51.249+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:51.250335+0000) 2021-08-03T12:13:51.311 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:51.309+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:51.309955+0000) 2021-08-03T12:13:51.338 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:51.334+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:51.335536+0000) 2021-08-03T12:13:51.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:51.415+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:51.416308+0000) 2021-08-03T12:13:51.468 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:51.466+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:51.466825+0000) 2021-08-03T12:13:51.704 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:51.700+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:51.701667+0000) 2021-08-03T12:13:51.795 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:51.792+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:51.793351+0000) 2021-08-03T12:13:52.252 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:52.250+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:52.251267+0000) 2021-08-03T12:13:52.312 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:52.310+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:52.310945+0000) 2021-08-03T12:13:52.338 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:52.335+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:52.336112+0000) 2021-08-03T12:13:52.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:52.415+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:52.416447+0000) 2021-08-03T12:13:52.796 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:52.793+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:52.793939+0000) 2021-08-03T12:13:53.253 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:53.251+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:53.252225+0000) 2021-08-03T12:13:53.312 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:53.311+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:53.311863+0000) 2021-08-03T12:13:53.339 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:53.336+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:53.336734+0000) 2021-08-03T12:13:53.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:53.415+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:53.416576+0000) 2021-08-03T12:13:53.442 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:13:53.440+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:53.441697+0000) 2021-08-03T12:13:53.797 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:53.793+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:53.794534+0000) 2021-08-03T12:13:54.073 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:54.071+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:54.072759+0000) 2021-08-03T12:13:54.254 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:54.252+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:54.253162+0000) 2021-08-03T12:13:54.315 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:54.312+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:54.313466+0000) 2021-08-03T12:13:54.339 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:54.336+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:54.337315+0000) 2021-08-03T12:13:54.415 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:54.413+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:54.414054+0000) 2021-08-03T12:13:54.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:54.415+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:54.416677+0000) 2021-08-03T12:13:54.797 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:54.794+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:54.795325+0000) 2021-08-03T12:13:55.027 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:55.024+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:55.025440+0000) 2021-08-03T12:13:55.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:55.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:55.072887+0000) 2021-08-03T12:13:55.255 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:55.253+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:55.254129+0000) 2021-08-03T12:13:55.316 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:55.314+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:55.315104+0000) 2021-08-03T12:13:55.340 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:55.337+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:55.337909+0000) 2021-08-03T12:13:55.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:55.416+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:55.416824+0000) 2021-08-03T12:13:55.798 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:55.795+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:55.796040+0000) 2021-08-03T12:13:56.028 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:56.025+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:56.026401+0000) 2021-08-03T12:13:56.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:56.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:56.073019+0000) 2021-08-03T12:13:56.256 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:56.254+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:56.255499+0000) 2021-08-03T12:13:56.340 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:56.337+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:56.338653+0000) 2021-08-03T12:13:56.373 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:13:55.839+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2748 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:13:56.418 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:56.416+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:56.416936+0000) 2021-08-03T12:13:56.798 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:56.795+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:56.796624+0000) 2021-08-03T12:13:57.029 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:57.026+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:57.026999+0000) 2021-08-03T12:13:57.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:57.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:57.073143+0000) 2021-08-03T12:13:57.258 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:57.256+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:57.256919+0000) 2021-08-03T12:13:57.341 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:57.338+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:57.339206+0000) 2021-08-03T12:13:57.418 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:57.416+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:57.417083+0000) 2021-08-03T12:13:57.799 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:57.796+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:57.797256+0000) 2021-08-03T12:13:57.975 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:13:57.971+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:57.972633+0000) 2021-08-03T12:13:58.029 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:58.027+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:58.027795+0000) 2021-08-03T12:13:58.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:58.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:58.073299+0000) 2021-08-03T12:13:58.260 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:58.257+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:58.258449+0000) 2021-08-03T12:13:58.341 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:58.339+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:58.339782+0000) 2021-08-03T12:13:58.365 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:13:58.105+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4813 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:13:58.418 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:58.416+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:58.417231+0000) 2021-08-03T12:13:58.800 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:58.797+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:58.798028+0000) 2021-08-03T12:13:58.933 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:13:58.929+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:58.930691+0000) 2021-08-03T12:13:58.989 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:13:58.987+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:13:59.030 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:13:59.028+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:59.028769+0000) 2021-08-03T12:13:59.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:59.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:59.073410+0000) 2021-08-03T12:13:59.260 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:13:59.258+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:59.259625+0000) 2021-08-03T12:13:59.342 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:13:59.339+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:59.340359+0000) 2021-08-03T12:13:59.418 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:59.416+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:59.417354+0000) 2021-08-03T12:13:59.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:13:59.606+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:59.607396+0000) 2021-08-03T12:13:59.800 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:13:59.798+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:13:59.798771+0000) 2021-08-03T12:14:00.031 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:00.028+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:00.029337+0000) 2021-08-03T12:14:00.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:00.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:00.073540+0000) 2021-08-03T12:14:00.263 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:00.260+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:00.261290+0000) 2021-08-03T12:14:00.343 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:00.340+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:00.341401+0000) 2021-08-03T12:14:00.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:00.416+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:00.417495+0000) 2021-08-03T12:14:00.801 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:00.798+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:00.799368+0000) 2021-08-03T12:14:01.032 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:01.029+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:01.030155+0000) 2021-08-03T12:14:01.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:01.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:01.073697+0000) 2021-08-03T12:14:01.206 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:01.202+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:01.203514+0000) 2021-08-03T12:14:01.264 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:01.262+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:01.263114+0000) 2021-08-03T12:14:01.344 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:01.341+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:01.342109+0000) 2021-08-03T12:14:01.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:01.416+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:01.417663+0000) 2021-08-03T12:14:01.801 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:01.799+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:01.799926+0000) 2021-08-03T12:14:02.025 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:02.023+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.023833+0000) 2021-08-03T12:14:02.033 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:02.030+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.030939+0000) 2021-08-03T12:14:02.075 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:02.073+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.073811+0000) 2021-08-03T12:14:02.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:02.263+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.264403+0000) 2021-08-03T12:14:02.345 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:02.342+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.342888+0000) 2021-08-03T12:14:02.418 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:02.417+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.417797+0000) 2021-08-03T12:14:02.802 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:02.799+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.800528+0000) 2021-08-03T12:14:02.814 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:02.812+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:02.813365+0000) 2021-08-03T12:14:03.033 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:03.030+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:03.031572+0000) 2021-08-03T12:14:03.075 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:03.073+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:03.073935+0000) 2021-08-03T12:14:03.269 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:03.265+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:03.266073+0000) 2021-08-03T12:14:03.345 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:03.342+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:03.343710+0000) 2021-08-03T12:14:03.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:03.417+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:03.417954+0000) 2021-08-03T12:14:03.803 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:03.800+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:03.801153+0000) 2021-08-03T12:14:04.034 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:04.031+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:04.032403+0000) 2021-08-03T12:14:04.268 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:04.266+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:04.267211+0000) 2021-08-03T12:14:04.346 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:04.343+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:04.344308+0000) 2021-08-03T12:14:04.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:04.417+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:04.418087+0000) 2021-08-03T12:14:04.806 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:04.801+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:04.801786+0000) 2021-08-03T12:14:05.035 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:05.032+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:05.032970+0000) 2021-08-03T12:14:05.191 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:04.903+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2751 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:05.269 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:05.267+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:05.268216+0000) 2021-08-03T12:14:05.346 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:05.344+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:05.344906+0000) 2021-08-03T12:14:05.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:05.417+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:05.418245+0000) 2021-08-03T12:14:05.492 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:05.490+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:05.490872+0000) 2021-08-03T12:14:06.035 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:06.032+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:06.033655+0000) 2021-08-03T12:14:06.065 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:05.850+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4813 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:06.227 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:06.223+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:06.224334+0000) 2021-08-03T12:14:06.271 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:06.269+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:06.269593+0000) 2021-08-03T12:14:06.347 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:06.344+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:06.345478+0000) 2021-08-03T12:14:06.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:06.417+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:06.418402+0000) 2021-08-03T12:14:06.494 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:06.490+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:06.491610+0000) 2021-08-03T12:14:06.640 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:06.278+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6272 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:07.029 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:07.025+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.026207+0000) 2021-08-03T12:14:07.036 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:07.033+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.034199+0000) 2021-08-03T12:14:07.039 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:07.037+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.038379+0000) 2021-08-03T12:14:07.121 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:07.118+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.119359+0000) 2021-08-03T12:14:07.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:07.271+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.271997+0000) 2021-08-03T12:14:07.348 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:07.345+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.346620+0000) 2021-08-03T12:14:07.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:07.417+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.418559+0000) 2021-08-03T12:14:07.493 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:07.491+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:07.492427+0000) 2021-08-03T12:14:08.002 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:08.000+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:08.001526+0000) 2021-08-03T12:14:08.036 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:08.034+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:08.034808+0000) 2021-08-03T12:14:08.498 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:08.493+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:08.494592+0000) 2021-08-03T12:14:08.739 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:08.736+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:08.737224+0000) 2021-08-03T12:14:09.004 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:09.002+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:09.003443+0000) 2021-08-03T12:14:09.243 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:09.239+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:09.240389+0000) 2021-08-03T12:14:09.497 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:09.494+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:09.495155+0000) 2021-08-03T12:14:10.005 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:10.003+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.004010+0000) 2021-08-03T12:14:10.122 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:10.119+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.120492+0000) 2021-08-03T12:14:10.137 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:10.131+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2751 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:10.137 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:10.135+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.135960+0000) 2021-08-03T12:14:10.143 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:10.142+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.142923+0000) 2021-08-03T12:14:10.497 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:10.495+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.495995+0000) 2021-08-03T12:14:10.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:10.577+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.578253+0000) 2021-08-03T12:14:10.894 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:10.892+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.893418+0000) 2021-08-03T12:14:10.993 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:10.989+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:10.990093+0000) 2021-08-03T12:14:11.006 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:11.003+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:11.004631+0000) 2021-08-03T12:14:11.497 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:11.495+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:11.496765+0000) 2021-08-03T12:14:11.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:11.577+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:11.578405+0000) 2021-08-03T12:14:11.593 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:11.590+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:11.590934+0000) 2021-08-03T12:14:11.665 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:11.365+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4813 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:12.008 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:12.004+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:12.005692+0000) 2021-08-03T12:14:12.498 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:12.496+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:12.497375+0000) 2021-08-03T12:14:12.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:12.577+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:12.578511+0000) 2021-08-03T12:14:13.009 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:13.007+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:13.008290+0000) 2021-08-03T12:14:13.096 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:13.092+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:13.093017+0000) 2021-08-03T12:14:13.420 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:13.165+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6283 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:13.447 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:13.444+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:13.444955+0000) 2021-08-03T12:14:13.499 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:13.497+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:13.497969+0000) 2021-08-03T12:14:13.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:13.577+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:13.578660+0000) 2021-08-03T12:14:13.635 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:13.630+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:13.631615+0000) 2021-08-03T12:14:13.818 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:13.815+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:13.816644+0000) 2021-08-03T12:14:14.010 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:14.008+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:14.008876+0000) 2021-08-03T12:14:14.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:14.198+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:14.199267+0000) 2021-08-03T12:14:14.499 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:14.497+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:14.498565+0000) 2021-08-03T12:14:14.580 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:14.577+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:14.578791+0000) 2021-08-03T12:14:15.010 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:15.008+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:15.009489+0000) 2021-08-03T12:14:15.128 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:15.125+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:15.126293+0000) 2021-08-03T12:14:15.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:15.198+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:15.199408+0000) 2021-08-03T12:14:15.501 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:15.498+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:15.499200+0000) 2021-08-03T12:14:15.580 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:15.578+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:15.578945+0000) 2021-08-03T12:14:15.602 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:15.600+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:15.601746+0000) 2021-08-03T12:14:15.664 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:15.662+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:15.663301+0000) 2021-08-03T12:14:16.011 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:16.009+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:16.010071+0000) 2021-08-03T12:14:16.128 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:16.126+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:16.126972+0000) 2021-08-03T12:14:16.156 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:16.154+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:16.155615+0000) 2021-08-03T12:14:16.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:16.198+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:16.199530+0000) 2021-08-03T12:14:16.501 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:16.499+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:16.500174+0000) 2021-08-03T12:14:16.580 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:16.578+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:16.579068+0000) 2021-08-03T12:14:17.012 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:17.010+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:17.011037+0000) 2021-08-03T12:14:17.129 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:17.126+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:17.127538+0000) 2021-08-03T12:14:17.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:17.198+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:17.199658+0000) 2021-08-03T12:14:17.501 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:17.499+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:17.500734+0000) 2021-08-03T12:14:17.580 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:17.578+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:17.579218+0000) 2021-08-03T12:14:18.012 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:18.010+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:18.011621+0000) 2021-08-03T12:14:18.130 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:18.127+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:18.128090+0000) 2021-08-03T12:14:18.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:18.199+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:18.199809+0000) 2021-08-03T12:14:18.503 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:18.500+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:18.501666+0000) 2021-08-03T12:14:18.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:18.543+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:18.543989+0000) 2021-08-03T12:14:18.580 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:18.578+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:18.579332+0000) 2021-08-03T12:14:18.994 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:18.993+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:18.994027+0000) 2021-08-03T12:14:19.014 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:19.012+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.013498+0000) 2021-08-03T12:14:19.101 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:19.099+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.099816+0000) 2021-08-03T12:14:19.130 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:19.127+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.128633+0000) 2021-08-03T12:14:19.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:19.199+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.199949+0000) 2021-08-03T12:14:19.503 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:19.501+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.502305+0000) 2021-08-03T12:14:19.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:19.543+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.544143+0000) 2021-08-03T12:14:19.580 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:19.578+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.579463+0000) 2021-08-03T12:14:19.693 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:19.677+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4814 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:19.859 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:19.848+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2756 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:19.994 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:19.993+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:19.994183+0000) 2021-08-03T12:14:20.015 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:20.013+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:20.014122+0000) 2021-08-03T12:14:20.101 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:20.100+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:20.100883+0000) 2021-08-03T12:14:20.131 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:20.128+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:20.129524+0000) 2021-08-03T12:14:20.271 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:20.265+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6302 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:20.504 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:20.502+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:20.503117+0000) 2021-08-03T12:14:20.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:20.543+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:20.544299+0000) 2021-08-03T12:14:20.994 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:20.993+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:20.994314+0000) 2021-08-03T12:14:21.016 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:21.014+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:21.014961+0000) 2021-08-03T12:14:21.102 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:21.100+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:21.101496+0000) 2021-08-03T12:14:21.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:21.410+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:21.411112+0000) 2021-08-03T12:14:21.504 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:21.502+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:21.503691+0000) 2021-08-03T12:14:21.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:21.543+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:21.544450+0000) 2021-08-03T12:14:21.991 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:21.985+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:21.987246+0000) 2021-08-03T12:14:21.994 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:21.993+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:21.994472+0000) 2021-08-03T12:14:22.017 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:22.015+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:22.015962+0000) 2021-08-03T12:14:22.505 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:22.503+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:22.504487+0000) 2021-08-03T12:14:22.995 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:22.993+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:22.994614+0000) 2021-08-03T12:14:23.018 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:23.015+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:23.016603+0000) 2021-08-03T12:14:23.506 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:23.504+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:23.504990+0000) 2021-08-03T12:14:23.785 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:23.782+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:23.783886+0000) 2021-08-03T12:14:23.995 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:23.993+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:23.994745+0000) 2021-08-03T12:14:24.018 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:24.016+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:24.017426+0000) 2021-08-03T12:14:24.507 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:24.504+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:24.505574+0000) 2021-08-03T12:14:24.923 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:24.920+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:24.922487+0000) 2021-08-03T12:14:24.995 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:24.994+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:24.994907+0000) 2021-08-03T12:14:25.019 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:25.017+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:25.018002+0000) 2021-08-03T12:14:25.316 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:25.310+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:25.312371+0000) 2021-08-03T12:14:25.507 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:25.505+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:25.506128+0000) 2021-08-03T12:14:25.995 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:25.994+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:25.995036+0000) 2021-08-03T12:14:26.020 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:26.017+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:26.018614+0000) 2021-08-03T12:14:26.153 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:25.557+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:26.402 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:26.398+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:26.399727+0000) 2021-08-03T12:14:26.508 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:26.506+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:26.507090+0000) 2021-08-03T12:14:26.526 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:26.463+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6302 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:26.531 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:26.526+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:26.528021+0000) 2021-08-03T12:14:26.863 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:26.859+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2771 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:26.877 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:26.871+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:26.872670+0000) 2021-08-03T12:14:26.950 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:26.947+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:26.949551+0000) 2021-08-03T12:14:26.995 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:26.994+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:26.995172+0000) 2021-08-03T12:14:27.020 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:27.018+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:27.019444+0000) 2021-08-03T12:14:27.420 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:27.415+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:27.417095+0000) 2021-08-03T12:14:27.508 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:27.506+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:27.507683+0000) 2021-08-03T12:14:27.995 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:27.994+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:27.995320+0000) 2021-08-03T12:14:28.021 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:28.019+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:28.020007+0000) 2021-08-03T12:14:28.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:28.277+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:28.278188+0000) 2021-08-03T12:14:28.509 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:28.507+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:28.508301+0000) 2021-08-03T12:14:29.024 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:29.021+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:29.022262+0000) 2021-08-03T12:14:29.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:29.278+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:29.279172+0000) 2021-08-03T12:14:29.510 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:29.508+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:29.509167+0000) 2021-08-03T12:14:29.773 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:29.770+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:29.772008+0000) 2021-08-03T12:14:29.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:29.798+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:29.800760+0000) 2021-08-03T12:14:30.024 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:30.022+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:30.023514+0000) 2021-08-03T12:14:30.281 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:30.279+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:30.279937+0000) 2021-08-03T12:14:30.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:30.323+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:30.325336+0000) 2021-08-03T12:14:30.393 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:30.390+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:30.392552+0000) 2021-08-03T12:14:30.511 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:30.509+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:30.510114+0000) 2021-08-03T12:14:30.753 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:30.751+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:30.752813+0000) 2021-08-03T12:14:31.025 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:31.023+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:31.024101+0000) 2021-08-03T12:14:31.281 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:31.279+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:31.280700+0000) 2021-08-03T12:14:31.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:31.324+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:31.325492+0000) 2021-08-03T12:14:31.443 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:31.439+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:31.440016+0000) 2021-08-03T12:14:31.511 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:31.509+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:31.510703+0000) 2021-08-03T12:14:32.026 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:32.023+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:32.024689+0000) 2021-08-03T12:14:32.282 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:32.280+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:32.281273+0000) 2021-08-03T12:14:32.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:32.324+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:32.325595+0000) 2021-08-03T12:14:32.512 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:32.510+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:32.511294+0000) 2021-08-03T12:14:32.671 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:32.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:32.669838+0000) 2021-08-03T12:14:32.676 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:32.542+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4838 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:33.027 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:33.024+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:33.025330+0000) 2021-08-03T12:14:33.263 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:32.874+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6302 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:33.283 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:33.281+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:33.282056+0000) 2021-08-03T12:14:33.513 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:33.511+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:33.512320+0000) 2021-08-03T12:14:33.671 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:33.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:33.669992+0000) 2021-08-03T12:14:34.028 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:34.026+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:34.026766+0000) 2021-08-03T12:14:34.284 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:34.281+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:34.282670+0000) 2021-08-03T12:14:34.515 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:34.512+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:34.513477+0000) 2021-08-03T12:14:34.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:34.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:34.670098+0000) 2021-08-03T12:14:35.029 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:35.026+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:35.027646+0000) 2021-08-03T12:14:35.284 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:35.282+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:35.283454+0000) 2021-08-03T12:14:35.517 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:35.513+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:35.514562+0000) 2021-08-03T12:14:35.671 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:35.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:35.670241+0000) 2021-08-03T12:14:35.855 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:35.852+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:35.853299+0000) 2021-08-03T12:14:36.030 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:36.028+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:36.029209+0000) 2021-08-03T12:14:36.285 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:36.283+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:36.284223+0000) 2021-08-03T12:14:36.460 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:35.883+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2771 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:36.671 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:36.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:36.670367+0000) 2021-08-03T12:14:36.876 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:36.873+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:36.874338+0000) 2021-08-03T12:14:37.031 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:37.029+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:37.030473+0000) 2021-08-03T12:14:37.285 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:37.283+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:37.284775+0000) 2021-08-03T12:14:37.671 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:37.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:37.670486+0000) 2021-08-03T12:14:37.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:37.735+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:37.736283+0000) 2021-08-03T12:14:37.877 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:37.874+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:37.875082+0000) 2021-08-03T12:14:38.035 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:38.031+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:38.032279+0000) 2021-08-03T12:14:38.112 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:38.109+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:38.110165+0000) 2021-08-03T12:14:38.261 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:38.258+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:38.259709+0000) 2021-08-03T12:14:38.287 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:38.284+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:38.285414+0000) 2021-08-03T12:14:38.633 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:38.631+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:38.632440+0000) 2021-08-03T12:14:38.671 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:38.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:38.670635+0000) 2021-08-03T12:14:38.877 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:38.874+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:38.875673+0000) 2021-08-03T12:14:39.288 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:39.285+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:39.286412+0000) 2021-08-03T12:14:39.391 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:39.274+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4843 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:39.597 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:39.594+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:39.594893+0000) 2021-08-03T12:14:39.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:39.635+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:39.636711+0000) 2021-08-03T12:14:39.671 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:39.669+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:39.670749+0000) 2021-08-03T12:14:39.878 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:39.875+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:39.876306+0000) 2021-08-03T12:14:40.288 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:40.286+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:40.286985+0000) 2021-08-03T12:14:40.379 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:40.360+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6303 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:40.387 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:40.384+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:40.385135+0000) 2021-08-03T12:14:40.889 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:40.882+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:40.883028+0000) 2021-08-03T12:14:41.288 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:41.286+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:41.287539+0000) 2021-08-03T12:14:41.444 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:41.442+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:41.443582+0000) 2021-08-03T12:14:41.715 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:41.713+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:41.714671+0000) 2021-08-03T12:14:41.885 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:41.882+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:41.883535+0000) 2021-08-03T12:14:42.290 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:42.287+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:42.288082+0000) 2021-08-03T12:14:42.445 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:42.443+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:42.444695+0000) 2021-08-03T12:14:42.886 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:42.883+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:42.884173+0000) 2021-08-03T12:14:43.289 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:43.287+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:43.288701+0000) 2021-08-03T12:14:43.446 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:43.444+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:43.445328+0000) 2021-08-03T12:14:43.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:43.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:43.451007+0000) 2021-08-03T12:14:43.719 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:43.664+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2777 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:43.886 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:43.883+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:43.884692+0000) 2021-08-03T12:14:43.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:43.912+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:43.912960+0000) 2021-08-03T12:14:44.290 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:44.288+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:44.289476+0000) 2021-08-03T12:14:44.317 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:44.315+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:44.316709+0000) 2021-08-03T12:14:44.447 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:44.445+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:44.446379+0000) 2021-08-03T12:14:44.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:44.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:44.451141+0000) 2021-08-03T12:14:44.732 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:44.682+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4843 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:44.770 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:44.768+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:44.769676+0000) 2021-08-03T12:14:44.890 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:44.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:44.888902+0000) 2021-08-03T12:14:45.291 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:45.289+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:45.290632+0000) 2021-08-03T12:14:45.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:45.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:45.451240+0000) 2021-08-03T12:14:45.890 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:45.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:45.889615+0000) 2021-08-03T12:14:46.218 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:46.217+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:46.218444+0000) 2021-08-03T12:14:46.292 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:46.290+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:46.291180+0000) 2021-08-03T12:14:46.323 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:46.321+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:46.321877+0000) 2021-08-03T12:14:46.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:46.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:46.451345+0000) 2021-08-03T12:14:46.510 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:46.507+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:46.508623+0000) 2021-08-03T12:14:46.892 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:46.889+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:46.890652+0000) 2021-08-03T12:14:47.076 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:47.073+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:47.073813+0000) 2021-08-03T12:14:47.088 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:47.084+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:47.085427+0000) 2021-08-03T12:14:47.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:47.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:47.451452+0000) 2021-08-03T12:14:47.892 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:47.890+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:47.891231+0000) 2021-08-03T12:14:48.066 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:47.928+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6329 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:48.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:48.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:48.451568+0000) 2021-08-03T12:14:48.516 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:48.513+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:48.513755+0000) 2021-08-03T12:14:48.893 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:48.891+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:48.891827+0000) 2021-08-03T12:14:48.982 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:48.979+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:48.980057+0000) 2021-08-03T12:14:48.996 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:48.994+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:48.995743+0000) 2021-08-03T12:14:49.443 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:49.440+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:49.441297+0000) 2021-08-03T12:14:49.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:49.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:49.451679+0000) 2021-08-03T12:14:49.846 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:49.842+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2782 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:49.894 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:49.891+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:49.892441+0000) 2021-08-03T12:14:49.996 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:49.995+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:49.995913+0000) 2021-08-03T12:14:50.143 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:50.141+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:50.141832+0000) 2021-08-03T12:14:50.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:50.451+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:50.451833+0000) 2021-08-03T12:14:50.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:50.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:50.579830+0000) 2021-08-03T12:14:50.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:50.795+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:50.796106+0000) 2021-08-03T12:14:50.894 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:50.892+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:50.893059+0000) 2021-08-03T12:14:50.996 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:50.995+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:50.996037+0000) 2021-08-03T12:14:51.137 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:51.134+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:51.135483+0000) 2021-08-03T12:14:51.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:51.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:51.579957+0000) 2021-08-03T12:14:51.593 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:51.590+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4843 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:51.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:51.795+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:51.796246+0000) 2021-08-03T12:14:51.895 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:51.893+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:51.894006+0000) 2021-08-03T12:14:51.996 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:51.995+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:51.996176+0000) 2021-08-03T12:14:52.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:52.471+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:52.472516+0000) 2021-08-03T12:14:52.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:52.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:52.580083+0000) 2021-08-03T12:14:52.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:52.795+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:52.796375+0000) 2021-08-03T12:14:52.896 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:52.893+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:52.894846+0000) 2021-08-03T12:14:52.997 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:52.994+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:52.996305+0000) 2021-08-03T12:14:53.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:53.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:53.580243+0000) 2021-08-03T12:14:53.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:53.795+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:53.796499+0000) 2021-08-03T12:14:53.896 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:53.893+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:53.895454+0000) 2021-08-03T12:14:54.259 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:14:54.255+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.256704+0000) 2021-08-03T12:14:54.289 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:54.287+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.288449+0000) 2021-08-03T12:14:54.439 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:14:54.436+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.437004+0000) 2021-08-03T12:14:54.533 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:14:54.509+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6332 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:14:54.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:54.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.580384+0000) 2021-08-03T12:14:54.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:54.795+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.796660+0000) 2021-08-03T12:14:54.860 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:54.856+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.858196+0000) 2021-08-03T12:14:54.898 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:54.894+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.896364+0000) 2021-08-03T12:14:54.919 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:54.916+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:54.918276+0000) 2021-08-03T12:14:55.454 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:14:55.450+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:55.451588+0000) 2021-08-03T12:14:55.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:55.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:55.580525+0000) 2021-08-03T12:14:55.742 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:14:55.740+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:55.742089+0000) 2021-08-03T12:14:55.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:55.796+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:55.796806+0000) 2021-08-03T12:14:55.919 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:55.917+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:55.918915+0000) 2021-08-03T12:14:56.150 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:14:55.939+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2790 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:14:56.316 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:14:56.312+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:56.314000+0000) 2021-08-03T12:14:56.329 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:14:56.324+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:56.326626+0000) 2021-08-03T12:14:56.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:56.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:56.580649+0000) 2021-08-03T12:14:56.798 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:56.796+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:56.796943+0000) 2021-08-03T12:14:56.920 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:56.917+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:56.919501+0000) 2021-08-03T12:14:57.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:57.579+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:57.580771+0000) 2021-08-03T12:14:57.921 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:57.918+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:57.920113+0000) 2021-08-03T12:14:58.582 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:58.580+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:58.580931+0000) 2021-08-03T12:14:58.765 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:14:58.648+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4843 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:14:58.922 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:14:58.919+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:58.921038+0000) 2021-08-03T12:14:59.051 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:14:59.046+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:59.047292+0000) 2021-08-03T12:14:59.582 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:14:59.580+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:59.581089+0000) 2021-08-03T12:14:59.600 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:14:59.596+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:14:59.598772+0000) 2021-08-03T12:15:00.079 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:00.076+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:00.077219+0000) 2021-08-03T12:15:00.307 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:00.305+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:00.306680+0000) 2021-08-03T12:15:00.582 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:00.580+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:00.581219+0000) 2021-08-03T12:15:00.633 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:00.631+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:00.631889+0000) 2021-08-03T12:15:01.080 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:01.077+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:01.077953+0000) 2021-08-03T12:15:01.102 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:01.021+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:01.634 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:01.631+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:01.632549+0000) 2021-08-03T12:15:02.029 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:02.026+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:02.027386+0000) 2021-08-03T12:15:02.080 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:02.077+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:02.078576+0000) 2021-08-03T12:15:02.634 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:02.632+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:02.633407+0000) 2021-08-03T12:15:03.081 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:03.078+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:03.079575+0000) 2021-08-03T12:15:03.635 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:03.633+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:03.634009+0000) 2021-08-03T12:15:04.082 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:04.079+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:04.080153+0000) 2021-08-03T12:15:04.244 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:04.240+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:04.241379+0000) 2021-08-03T12:15:04.299 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:15:04.279+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2809 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:15:04.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:04.567+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:04.568042+0000) 2021-08-03T12:15:04.635 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:04.633+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:04.634579+0000) 2021-08-03T12:15:05.007 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:05.005+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:05.006727+0000) 2021-08-03T12:15:05.082 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:05.080+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:05.080747+0000) 2021-08-03T12:15:05.636 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:05.634+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:05.635410+0000) 2021-08-03T12:15:06.009 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:05.998+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4843 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:06.083 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:06.080+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:06.081371+0000) 2021-08-03T12:15:06.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:06.713+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:06.714026+0000) 2021-08-03T12:15:06.902 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:06.898+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:06.898960+0000) 2021-08-03T12:15:07.084 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:07.081+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:07.081978+0000) 2021-08-03T12:15:07.303 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:07.300+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:07.301574+0000) 2021-08-03T12:15:07.335 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:07.333+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:07.334764+0000) 2021-08-03T12:15:07.680 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:07.678+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:07.679192+0000) 2021-08-03T12:15:07.708 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:07.705+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:07.923 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:07.921+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:07.922367+0000) 2021-08-03T12:15:08.033 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:08.031+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:08.032338+0000) 2021-08-03T12:15:08.084 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:08.081+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:08.082593+0000) 2021-08-03T12:15:08.556 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:08.552+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:08.553349+0000) 2021-08-03T12:15:08.681 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:08.679+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:08.679923+0000) 2021-08-03T12:15:08.923 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:08.921+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:08.922541+0000) 2021-08-03T12:15:09.085 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:09.082+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:09.083179+0000) 2021-08-03T12:15:09.682 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:09.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:09.680824+0000) 2021-08-03T12:15:09.923 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:09.921+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:09.922690+0000) 2021-08-03T12:15:10.054 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:10.052+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:10.053289+0000) 2021-08-03T12:15:10.085 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:10.083+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:10.083759+0000) 2021-08-03T12:15:10.111 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:10.109+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:10.109767+0000) 2021-08-03T12:15:10.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:10.637+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:10.638433+0000) 2021-08-03T12:15:10.682 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:10.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:10.681632+0000) 2021-08-03T12:15:10.924 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:10.921+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:10.922839+0000) 2021-08-03T12:15:11.055 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:11.053+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:11.054310+0000) 2021-08-03T12:15:11.087 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:11.083+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:11.085163+0000) 2021-08-03T12:15:11.112 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:11.109+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:11.110894+0000) 2021-08-03T12:15:11.464 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:11.461+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:11.462077+0000) 2021-08-03T12:15:11.643 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:11.640+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:11.641998+0000) 2021-08-03T12:15:11.684 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:11.681+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:11.682437+0000) 2021-08-03T12:15:11.924 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:11.921+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:11.922968+0000) 2021-08-03T12:15:12.055 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:12.054+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:12.054907+0000) 2021-08-03T12:15:12.087 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:12.084+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:12.085924+0000) 2021-08-03T12:15:12.113 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:12.110+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:12.111871+0000) 2021-08-03T12:15:12.644 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:12.641+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:12.643219+0000) 2021-08-03T12:15:12.684 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:12.682+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:12.683009+0000) 2021-08-03T12:15:12.857 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:12.580+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4849 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:13.043 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:13.040+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:13.042533+0000) 2021-08-03T12:15:13.056 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:13.054+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:13.055477+0000) 2021-08-03T12:15:13.088 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:13.084+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:13.086691+0000) 2021-08-03T12:15:13.115 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:13.111+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:13.113160+0000) 2021-08-03T12:15:13.613 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:15:13.544+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2814 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:15:13.644 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:13.641+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:13.643386+0000) 2021-08-03T12:15:13.685 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:13.682+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:13.683573+0000) 2021-08-03T12:15:14.057 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:14.055+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:14.056061+0000) 2021-08-03T12:15:14.090 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:14.085+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:14.087469+0000) 2021-08-03T12:15:14.115 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:14.112+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:14.114076+0000) 2021-08-03T12:15:14.644 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:14.641+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:14.643588+0000) 2021-08-03T12:15:14.685 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:14.683+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:14.684382+0000) 2021-08-03T12:15:14.807 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:14.804+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:14.806319+0000) 2021-08-03T12:15:15.091 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:15.086+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:15.088082+0000) 2021-08-03T12:15:15.322 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:15.113+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:15.115230+0000) 2021-08-03T12:15:15.644 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:15.641+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:15.643703+0000) 2021-08-03T12:15:15.686 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:15.684+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:15.685177+0000) 2021-08-03T12:15:15.856 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:15.855+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:15.855916+0000) 2021-08-03T12:15:16.091 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:16.086+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.088656+0000) 2021-08-03T12:15:16.091 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:16.040+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:16.118 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:16.114+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.116400+0000) 2021-08-03T12:15:16.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:16.195+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.196974+0000) 2021-08-03T12:15:16.559 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:16.557+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.558038+0000) 2021-08-03T12:15:16.617 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:16.613+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.615239+0000) 2021-08-03T12:15:16.645 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:16.642+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.643900+0000) 2021-08-03T12:15:16.687 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:16.684+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.685751+0000) 2021-08-03T12:15:16.766 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:16.763+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:16.764951+0000) 2021-08-03T12:15:17.060 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:17.057+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:17.058057+0000) 2021-08-03T12:15:17.091 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:17.087+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:17.089600+0000) 2021-08-03T12:15:17.119 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:17.115+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:17.117323+0000) 2021-08-03T12:15:17.645 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:17.642+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:17.644051+0000) 2021-08-03T12:15:17.687 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:17.685+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:17.686346+0000) 2021-08-03T12:15:17.766 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:17.763+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:17.765103+0000) 2021-08-03T12:15:18.092 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:18.088+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:18.090180+0000) 2021-08-03T12:15:18.120 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:18.116+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:18.118433+0000) 2021-08-03T12:15:18.692 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:18.687+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:18.688028+0000) 2021-08-03T12:15:18.766 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:18.763+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:18.765219+0000) 2021-08-03T12:15:19.690 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:19.688+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:19.688848+0000) 2021-08-03T12:15:19.766 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:19.764+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:19.765328+0000) 2021-08-03T12:15:19.928 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:19.779+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4888 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:19.975 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:19.973+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:19.974265+0000) 2021-08-03T12:15:20.096 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:20.092+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:20.093017+0000) 2021-08-03T12:15:20.137 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:20.135+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:20.136043+0000) 2021-08-03T12:15:20.772 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:15:20.767+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2815 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:15:20.977 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:20.975+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:20.976000+0000) 2021-08-03T12:15:21.274 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:21.271+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:21.271763+0000) 2021-08-03T12:15:21.364 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:21.360+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:21.361671+0000) 2021-08-03T12:15:21.398 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:21.397+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:21.398345+0000) 2021-08-03T12:15:21.978 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:21.975+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:21.976605+0000) 2021-08-03T12:15:22.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:22.561+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:22.562395+0000) 2021-08-03T12:15:22.978 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:22.976+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:22.977456+0000) 2021-08-03T12:15:23.049 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:23.047+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:23.048372+0000) 2021-08-03T12:15:23.187 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:23.184+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:23.185456+0000) 2021-08-03T12:15:23.366 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:23.193+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:23.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:23.469+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:23.470227+0000) 2021-08-03T12:15:23.675 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:23.672+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:23.672990+0000) 2021-08-03T12:15:23.979 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:23.977+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:23.978046+0000) 2021-08-03T12:15:24.049 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:24.047+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:24.048511+0000) 2021-08-03T12:15:24.499 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:15:24.496+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:24.497158+0000) 2021-08-03T12:15:24.979 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:24.977+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:24.978638+0000) 2021-08-03T12:15:25.049 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:25.047+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:25.048655+0000) 2021-08-03T12:15:25.188 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:25.185+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:25.186794+0000) 2021-08-03T12:15:25.221 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:25.219+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:25.220543+0000) 2021-08-03T12:15:25.981 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:25.978+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:25.979214+0000) 2021-08-03T12:15:26.050 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:26.047+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:26.048781+0000) 2021-08-03T12:15:26.188 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:26.186+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:26.187517+0000) 2021-08-03T12:15:26.981 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:26.979+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:26.980015+0000) 2021-08-03T12:15:27.050 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:27.048+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:27.048949+0000) 2021-08-03T12:15:27.189 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:27.187+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:27.188318+0000) 2021-08-03T12:15:27.288 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:15:27.243+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2820 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:15:27.602 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:27.574+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4906 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:28.015 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:28.013+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:28.014617+0000) 2021-08-03T12:15:28.488 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:28.485+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:28.485983+0000) 2021-08-03T12:15:28.493 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:28.489+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:28.489913+0000) 2021-08-03T12:15:28.900 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:28.898+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:28.899729+0000) 2021-08-03T12:15:28.951 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:28.947+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:28.948617+0000) 2021-08-03T12:15:29.051 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:29.049+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:29.050065+0000) 2021-08-03T12:15:29.220 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:29.217+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:29.218570+0000) 2021-08-03T12:15:29.692 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:29.689+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:29.690221+0000) 2021-08-03T12:15:30.052 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:30.049+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:30.050592+0000) 2021-08-03T12:15:30.091 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:30.088+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:30.089093+0000) 2021-08-03T12:15:30.107 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:30.105+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:30.105985+0000) 2021-08-03T12:15:30.221 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:30.218+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:30.219164+0000) 2021-08-03T12:15:30.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:30.360+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:30.360878+0000) 2021-08-03T12:15:30.680 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:30.678+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:30.679502+0000) 2021-08-03T12:15:31.052 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:15:31.048+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:31.049060+0000) 2021-08-03T12:15:31.053 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:31.050+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:31.051204+0000) 2021-08-03T12:15:31.221 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:31.219+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:31.219775+0000) 2021-08-03T12:15:31.966 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:31.590+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:32.054 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:32.051+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:32.052307+0000) 2021-08-03T12:15:32.222 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:32.219+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:32.220414+0000) 2021-08-03T12:15:32.409 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:32.405+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:32.406415+0000) 2021-08-03T12:15:32.875 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:32.872+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:32.873598+0000) 2021-08-03T12:15:33.054 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:33.052+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:33.052917+0000) 2021-08-03T12:15:33.223 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:33.220+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:33.220973+0000) 2021-08-03T12:15:33.875 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:33.873+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:33.874308+0000) 2021-08-03T12:15:34.055 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:34.052+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:34.053497+0000) 2021-08-03T12:15:34.223 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:34.220+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:34.221688+0000) 2021-08-03T12:15:34.830 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:34.704+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4913 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:35.056 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:35.053+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:35.054077+0000) 2021-08-03T12:15:35.573 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:35.571+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:35.572630+0000) 2021-08-03T12:15:35.573 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:15:35.569+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2826 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:15:35.719 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:35.715+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:35.716244+0000) 2021-08-03T12:15:36.190 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:36.188+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:36.189516+0000) 2021-08-03T12:15:36.367 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:36.363+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:36.364610+0000) 2021-08-03T12:15:37.509 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:37.506+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:37.507758+0000) 2021-08-03T12:15:38.038 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:38.035+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:38.036672+0000) 2021-08-03T12:15:38.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:38.570+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:38.571554+0000) 2021-08-03T12:15:38.722 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:38.668+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:38.802 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:38.798+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:38.799028+0000) 2021-08-03T12:15:39.212 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:15:39.209+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:39.209765+0000) 2021-08-03T12:15:39.840 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:39.838+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:39.839526+0000) 2021-08-03T12:15:40.000 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:15:39.996+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:39.997054+0000) 2021-08-03T12:15:40.495 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:40.493+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:40.493866+0000) 2021-08-03T12:15:41.322 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:41.320+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:41.320858+0000) 2021-08-03T12:15:41.917 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:41.904+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:41.905063+0000) 2021-08-03T12:15:42.029 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:41.817+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4930 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:42.322 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:42.320+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:42.321572+0000) 2021-08-03T12:15:43.018 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:43.015+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:43.016247+0000) 2021-08-03T12:15:43.113 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:15:42.704+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2826 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:15:43.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:43.132+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:43.132983+0000) 2021-08-03T12:15:43.323 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:43.321+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:43.322126+0000) 2021-08-03T12:15:43.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:43.632+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:43.633761+0000) 2021-08-03T12:15:43.751 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:15:43.748+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:43.749442+0000) 2021-08-03T12:15:43.959 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:43.925+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6351 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:43.997 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:43.996+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:43.997217+0000) 2021-08-03T12:15:44.325 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:44.322+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:44.322991+0000) 2021-08-03T12:15:44.997 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:44.996+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:44.997375+0000) 2021-08-03T12:15:45.324 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:45.322+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:45.323550+0000) 2021-08-03T12:15:45.342 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:45.339+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:45.339935+0000) 2021-08-03T12:15:45.998 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:45.996+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:45.997506+0000) 2021-08-03T12:15:46.326 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:46.324+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:46.324801+0000) 2021-08-03T12:15:46.998 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:46.996+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:46.997659+0000) 2021-08-03T12:15:47.326 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:47.324+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:47.325586+0000) 2021-08-03T12:15:47.599 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:47.595+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:47.596428+0000) 2021-08-03T12:15:47.643 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:47.639+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:47.640774+0000) 2021-08-03T12:15:47.998 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:47.996+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:47.997793+0000) 2021-08-03T12:15:48.027 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:48.024+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:48.025480+0000) 2021-08-03T12:15:48.327 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:15:48.325+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:48.326462+0000) 2021-08-03T12:15:48.645 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:48.643+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:48.644615+0000) 2021-08-03T12:15:48.951 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:48.916+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4937 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:48.998 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:48.997+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:48.997936+0000) 2021-08-03T12:15:52.236 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:15:52.233+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:52.233781+0000) 2021-08-03T12:15:52.314 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:52.312+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:52.312931+0000) 2021-08-03T12:15:52.667 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:15:52.664+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:52.665095+0000) 2021-08-03T12:15:52.845 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:52.270+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6351 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:53.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:53.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:53.362106+0000) 2021-08-03T12:15:53.513 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:53.511+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:53.511873+0000) 2021-08-03T12:15:53.650 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:15:52.955+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2826 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:15:53.913 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:53.911+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:53.912543+0000) 2021-08-03T12:15:54.109 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:54.107+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:54.108392+0000) 2021-08-03T12:15:54.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:54.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:54.362268+0000) 2021-08-03T12:15:54.514 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:54.512+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:54.512866+0000) 2021-08-03T12:15:55.270 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:15:55.266+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4974 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:15:55.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:55.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:55.362411+0000) 2021-08-03T12:15:55.515 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:15:55.512+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:55.513708+0000) 2021-08-03T12:15:55.826 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:55.823+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:55.824396+0000) 2021-08-03T12:15:56.288 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:15:56.284+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:56.285244+0000) 2021-08-03T12:15:57.662 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:57.660+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:57.661573+0000) 2021-08-03T12:15:58.136 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:15:58.117+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6351 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:15:58.663 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:58.661+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:58.662557+0000) 2021-08-03T12:15:59.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:15:59.126+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:59.127576+0000) 2021-08-03T12:15:59.579 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:15:59.578+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:59.579558+0000) 2021-08-03T12:15:59.633 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:15:59.628+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:59.629943+0000) 2021-08-03T12:15:59.664 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:15:59.662+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:15:59.663136+0000) 2021-08-03T12:16:00.194 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:00.191+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:00.193730+0000) 2021-08-03T12:16:00.291 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:00.288+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:00.288969+0000) 2021-08-03T12:16:00.545 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:00.541+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:00.543459+0000) 2021-08-03T12:16:00.665 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:00.663+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:00.663765+0000) 2021-08-03T12:16:01.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:01.183+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:01.184985+0000) 2021-08-03T12:16:01.445 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:00.936+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2830 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:01.546 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:01.542+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:01.543990+0000) 2021-08-03T12:16:01.591 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:01.186+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 4996 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:01.668 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:01.663+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:01.665282+0000) 2021-08-03T12:16:02.175 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:16:02.172+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:02.173823+0000) 2021-08-03T12:16:02.371 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:02.368+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:02.369910+0000) 2021-08-03T12:16:02.547 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:02.543+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:02.545050+0000) 2021-08-03T12:16:02.667 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:02.664+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:02.666004+0000) 2021-08-03T12:16:02.924 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:02.920+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:02.922769+0000) 2021-08-03T12:16:03.547 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:03.543+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:03.545640+0000) 2021-08-03T12:16:03.667 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:03.664+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:03.666594+0000) 2021-08-03T12:16:03.770 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:03.766+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:03.768299+0000) 2021-08-03T12:16:03.924 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:03.921+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:03.923516+0000) 2021-08-03T12:16:04.308 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:04.306+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:04.308189+0000) 2021-08-03T12:16:04.550 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:04.544+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:04.546605+0000) 2021-08-03T12:16:04.925 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:04.922+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:04.924362+0000) 2021-08-03T12:16:05.123 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:05.119+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:05.120803+0000) 2021-08-03T12:16:05.359 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:16:05.354+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:05.356282+0000) 2021-08-03T12:16:05.551 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:05.547+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:05.549598+0000) 2021-08-03T12:16:05.803 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:05.049+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6351 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:05.925 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:05.923+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:05.924951+0000) 2021-08-03T12:16:06.059 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:06.055+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:06.057482+0000) 2021-08-03T12:16:06.551 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:06.548+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:06.550156+0000) 2021-08-03T12:16:06.927 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:06.923+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:06.925540+0000) 2021-08-03T12:16:07.060 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:07.056+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:07.058171+0000) 2021-08-03T12:16:07.355 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:16:07.351+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:07.353568+0000) 2021-08-03T12:16:07.423 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:07.420+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:07.421939+0000) 2021-08-03T12:16:07.552 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:07.548+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:07.550718+0000) 2021-08-03T12:16:07.784 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:07.780+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:07.782128+0000) 2021-08-03T12:16:07.927 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:07.924+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:07.926112+0000) 2021-08-03T12:16:08.060 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:08.057+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:08.058763+0000) 2021-08-03T12:16:08.553 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:08.550+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:08.551554+0000) 2021-08-03T12:16:08.555 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:08.037+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2830 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:08.995 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:08.993+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:08.993840+0000) 2021-08-03T12:16:09.371 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:09.262+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5036 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:10.017 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:10.015+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:10.016111+0000) 2021-08-03T12:16:11.248 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:11.246+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:11.246810+0000) 2021-08-03T12:16:11.581 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:11.580+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:11.580964+0000) 2021-08-03T12:16:11.787 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:11.785+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:11.786063+0000) 2021-08-03T12:16:12.445 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:12.442+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:12.442989+0000) 2021-08-03T12:16:12.618 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:12.615+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:12.615985+0000) 2021-08-03T12:16:13.053 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:13.048+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:13.049525+0000) 2021-08-03T12:16:13.431 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:13.314+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6351 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:13.784 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:13.782+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:13.783086+0000) 2021-08-03T12:16:13.826 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:16:13.822+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:13.823707+0000) 2021-08-03T12:16:14.197 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:16:14.194+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:14.195248+0000) 2021-08-03T12:16:14.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:14.195+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:14.196459+0000) 2021-08-03T12:16:14.200 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:14.197+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:14.198028+0000) 2021-08-03T12:16:14.552 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:14.356+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2832 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:14.675 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:14.672+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:14.673017+0000) 2021-08-03T12:16:14.788 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:14.707+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5048 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:17.607 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:17.605+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:17.606699+0000) 2021-08-03T12:16:17.608 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:17.606+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:17.607727+0000) 2021-08-03T12:16:18.759 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:18.757+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:18.757835+0000) 2021-08-03T12:16:19.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:19.646+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:19.647495+0000) 2021-08-03T12:16:19.760 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:16:19.757+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:19.758522+0000) 2021-08-03T12:16:19.795 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:19.792+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:19.793105+0000) 2021-08-03T12:16:19.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:19.965+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:19.966489+0000) 2021-08-03T12:16:19.998 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:19.997+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:19.998474+0000) 2021-08-03T12:16:20.018 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:20.016+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:20.017798+0000) 2021-08-03T12:16:20.069 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:20.003+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6353 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:20.274 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:20.271+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:20.272787+0000) 2021-08-03T12:16:20.583 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:20.581+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:20.581923+0000) 2021-08-03T12:16:20.651 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:20.649+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:20.650018+0000) 2021-08-03T12:16:20.701 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:16:20.698+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:20.699200+0000) 2021-08-03T12:16:20.703 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:20.700+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:20.701805+0000) 2021-08-03T12:16:20.999 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:20.997+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:20.998618+0000) 2021-08-03T12:16:21.024 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:21.017+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5063 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:21.028 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:21.025+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:21.026043+0000) 2021-08-03T12:16:22.005 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:22.002+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:22.003389+0000) 2021-08-03T12:16:22.435 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:22.102+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2832 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:23.241 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:23.237+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:23.238632+0000) 2021-08-03T12:16:23.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:23.245+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:23.246029+0000) 2021-08-03T12:16:24.644 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:24.643+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:24.643953+0000) 2021-08-03T12:16:24.745 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:24.741+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:24.742654+0000) 2021-08-03T12:16:24.899 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:24.897+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:24.898553+0000) 2021-08-03T12:16:25.515 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:25.513+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:25.514396+0000) 2021-08-03T12:16:25.547 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:25.545+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:25.545926+0000) 2021-08-03T12:16:25.749 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:25.744+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:25.745654+0000) 2021-08-03T12:16:25.840 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:16:25.836+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:25.837124+0000) 2021-08-03T12:16:25.897 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:25.894+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:25.894973+0000) 2021-08-03T12:16:26.738 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:26.644+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6353 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:26.748 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:26.745+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:26.746393+0000) 2021-08-03T12:16:26.987 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:26.984+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:26.985697+0000) 2021-08-03T12:16:27.454 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:27.452+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:27.452992+0000) 2021-08-03T12:16:27.500 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:27.498+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:27.499777+0000) 2021-08-03T12:16:27.748 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:27.746+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:27.746946+0000) 2021-08-03T12:16:28.326 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:28.308+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5066 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:28.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:28.360+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:28.361176+0000) 2021-08-03T12:16:28.570 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:28.370+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2832 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:28.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:28.571+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:28.572031+0000) 2021-08-03T12:16:28.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:28.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:28.734984+0000) 2021-08-03T12:16:29.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:29.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:29.735089+0000) 2021-08-03T12:16:30.022 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:30.020+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:30.021189+0000) 2021-08-03T12:16:30.291 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:30.287+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:30.288213+0000) 2021-08-03T12:16:30.529 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:30.525+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:30.526431+0000) 2021-08-03T12:16:30.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:30.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:30.735216+0000) 2021-08-03T12:16:31.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:31.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:31.735371+0000) 2021-08-03T12:16:31.832 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:31.828+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:31.829744+0000) 2021-08-03T12:16:31.855 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:31.852+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:31.853034+0000) 2021-08-03T12:16:32.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:32.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:32.735523+0000) 2021-08-03T12:16:32.817 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:32.813+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:32.813800+0000) 2021-08-03T12:16:33.438 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:33.386+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6356 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:33.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:33.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:33.735664+0000) 2021-08-03T12:16:34.632 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:34.630+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:34.631689+0000) 2021-08-03T12:16:34.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:34.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:34.735804+0000) 2021-08-03T12:16:34.866 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:34.862+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:34.863285+0000) 2021-08-03T12:16:34.969 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:34.917+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2832 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:34.972 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:16:34.969+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:34.970030+0000) 2021-08-03T12:16:34.974 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:34.838+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5090 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:35.019 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:16:35.016+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:35.017636+0000) 2021-08-03T12:16:35.696 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:35.694+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:35.694840+0000) 2021-08-03T12:16:35.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:35.735+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:35.735947+0000) 2021-08-03T12:16:36.045 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:36.042+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:36.043309+0000) 2021-08-03T12:16:36.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:36.198+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:36.199498+0000) 2021-08-03T12:16:36.697 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:36.694+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:36.695635+0000) 2021-08-03T12:16:37.164 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:37.161+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:37.161978+0000) 2021-08-03T12:16:37.698 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:37.695+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:37.696250+0000) 2021-08-03T12:16:38.133 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:38.129+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:38.130403+0000) 2021-08-03T12:16:38.699 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:38.696+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:38.697221+0000) 2021-08-03T12:16:38.844 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:38.842+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:38.843504+0000) 2021-08-03T12:16:39.054 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:39.052+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:39.053415+0000) 2021-08-03T12:16:39.064 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:39.061+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:39.062569+0000) 2021-08-03T12:16:39.079 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:39.075+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:39.076626+0000) 2021-08-03T12:16:39.699 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:39.697+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:39.697862+0000) 2021-08-03T12:16:40.065 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:40.062+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:40.063160+0000) 2021-08-03T12:16:40.700 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:40.697+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:40.698469+0000) 2021-08-03T12:16:41.065 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:41.063+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:41.063966+0000) 2021-08-03T12:16:41.193 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:41.189+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:41.190664+0000) 2021-08-03T12:16:41.197 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:41.162+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6356 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:41.700 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:41.698+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:41.699066+0000) 2021-08-03T12:16:42.067 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:42.064+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:42.065204+0000) 2021-08-03T12:16:42.475 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:42.472+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5112 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:42.760 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:42.649+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2832 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:43.067 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:43.065+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:43.065975+0000) 2021-08-03T12:16:43.939 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:43.937+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:43.937841+0000) 2021-08-03T12:16:44.002 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:44.000+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:44.000855+0000) 2021-08-03T12:16:44.184 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:44.180+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:44.181481+0000) 2021-08-03T12:16:44.940 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:44.937+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:44.938560+0000) 2021-08-03T12:16:45.944 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:45.941+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:45.942356+0000) 2021-08-03T12:16:46.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:46.254+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:46.255091+0000) 2021-08-03T12:16:46.945 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:46.942+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:46.943166+0000) 2021-08-03T12:16:47.901 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:16:47.898+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:47.899287+0000) 2021-08-03T12:16:47.945 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:47.942+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:47.943803+0000) 2021-08-03T12:16:48.090 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:16:48.086+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:48.088271+0000) 2021-08-03T12:16:48.372 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:48.367+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:48.369654+0000) 2021-08-03T12:16:48.946 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:48.942+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:48.944385+0000) 2021-08-03T12:16:49.948 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:49.944+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:49.945827+0000) 2021-08-03T12:16:50.494 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:50.437+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6356 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:50.640 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:50.606+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5150 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:50.948 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:50.944+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:50.946529+0000) 2021-08-03T12:16:51.239 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:51.237+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:51.238088+0000) 2021-08-03T12:16:51.652 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:51.649+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:51.651235+0000) 2021-08-03T12:16:51.949 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:51.945+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:51.947266+0000) 2021-08-03T12:16:51.999 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:51.998+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:51.999091+0000) 2021-08-03T12:16:52.155 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:52.151+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.153044+0000) 2021-08-03T12:16:52.240 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:52.238+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.239073+0000) 2021-08-03T12:16:52.533 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:52.530+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.532235+0000) 2021-08-03T12:16:52.550 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:16:52.546+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2832 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:16:52.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:52.651+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.653799+0000) 2021-08-03T12:16:52.679 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:16:52.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.677493+0000) 2021-08-03T12:16:52.785 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:16:52.781+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.783296+0000) 2021-08-03T12:16:52.949 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:52.946+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.947863+0000) 2021-08-03T12:16:52.999 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:52.998+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:52.999216+0000) 2021-08-03T12:16:53.155 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:53.151+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:53.153708+0000) 2021-08-03T12:16:53.241 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:53.239+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:53.239937+0000) 2021-08-03T12:16:53.660 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:53.657+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:53.659557+0000) 2021-08-03T12:16:53.999 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:53.998+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:53.999339+0000) 2021-08-03T12:16:54.156 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:54.152+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:54.154398+0000) 2021-08-03T12:16:54.241 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:54.239+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:54.240501+0000) 2021-08-03T12:16:54.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:54.709+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:54.711035+0000) 2021-08-03T12:16:54.824 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:16:54.821+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:54.822655+0000) 2021-08-03T12:16:55.000 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:54.998+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:54.999459+0000) 2021-08-03T12:16:55.157 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:55.153+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:55.155521+0000) 2021-08-03T12:16:55.242 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:55.240+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:55.241058+0000) 2021-08-03T12:16:55.276 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:16:55.273+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:55.274573+0000) 2021-08-03T12:16:56.000 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:55.998+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:55.999601+0000) 2021-08-03T12:16:56.158 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:56.154+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:56.156139+0000) 2021-08-03T12:16:56.242 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:56.240+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:56.241621+0000) 2021-08-03T12:16:57.000 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:16:56.998+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:56.999723+0000) 2021-08-03T12:16:57.158 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:57.155+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:57.156657+0000) 2021-08-03T12:16:57.243 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:16:57.241+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:57.242161+0000) 2021-08-03T12:16:58.075 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:16:58.019+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5173 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:16:58.159 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:58.156+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:58.157657+0000) 2021-08-03T12:16:58.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:16:58.198+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:58.198902+0000) 2021-08-03T12:16:58.333 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:16:58.330+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:58.331068+0000) 2021-08-03T12:16:58.553 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:16:58.535+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6360 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:16:59.160 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:16:59.157+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:16:59.158207+0000) 2021-08-03T12:17:00.160 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:00.158+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:00.158773+0000) 2021-08-03T12:17:00.337 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:00.334+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2843 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:00.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:00.881+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:00.882523+0000) 2021-08-03T12:17:01.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:01.079+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:01.080696+0000) 2021-08-03T12:17:01.161 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:01.158+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:01.159482+0000) 2021-08-03T12:17:01.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:01.717+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:01.718606+0000) 2021-08-03T12:17:02.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:02.484+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:02.485056+0000) 2021-08-03T12:17:02.898 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:02.894+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:02.895113+0000) 2021-08-03T12:17:03.999 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:03.566+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5176 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:04.171 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:04.169+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:04.169921+0000) 2021-08-03T12:17:04.333 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:04.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:04.332071+0000) 2021-08-03T12:17:05.333 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:05.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:05.332233+0000) 2021-08-03T12:17:05.460 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:05.456+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:05.457373+0000) 2021-08-03T12:17:05.505 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:05.502+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:05.502946+0000) 2021-08-03T12:17:05.526 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:05.523+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:05.523894+0000) 2021-08-03T12:17:05.761 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:05.758+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:05.759055+0000) 2021-08-03T12:17:05.825 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:05.810+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2848 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:06.141 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:06.064+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:06.766 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:06.764+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:06.765143+0000) 2021-08-03T12:17:07.093 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:07.091+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:07.092600+0000) 2021-08-03T12:17:07.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:07.557+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:07.557876+0000) 2021-08-03T12:17:08.119 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:08.113+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:08.114345+0000) 2021-08-03T12:17:08.289 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:08.287+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:08.288080+0000) 2021-08-03T12:17:08.550 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:08.547+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:08.548019+0000) 2021-08-03T12:17:08.661 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:08.658+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:08.659606+0000) 2021-08-03T12:17:09.141 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:09.138+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:09.138925+0000) 2021-08-03T12:17:09.660 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:09.658+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:09.659094+0000) 2021-08-03T12:17:10.141 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:10.139+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:10.139760+0000) 2021-08-03T12:17:10.358 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:10.355+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:10.356128+0000) 2021-08-03T12:17:10.401 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:10.330+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5187 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:10.944 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:10.942+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:10.943939+0000) 2021-08-03T12:17:11.160 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:11.159+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:11.159878+0000) 2021-08-03T12:17:11.290 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:11.288+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:11.289621+0000) 2021-08-03T12:17:11.474 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:11.293+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:12.047 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:12.044+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:12.045567+0000) 2021-08-03T12:17:12.087 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:12.084+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:12.084926+0000) 2021-08-03T12:17:12.374 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:12.370+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2862 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:12.707 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:12.701+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:12.702463+0000) 2021-08-03T12:17:13.124 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:13.120+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:13.121418+0000) 2021-08-03T12:17:13.590 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:13.586+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:13.587847+0000) 2021-08-03T12:17:13.705 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:13.702+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:13.703201+0000) 2021-08-03T12:17:13.920 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:13.918+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:13.919022+0000) 2021-08-03T12:17:14.705 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:14.703+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:14.703964+0000) 2021-08-03T12:17:15.609 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:15.605+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:15.606476+0000) 2021-08-03T12:17:15.706 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:15.703+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:15.704592+0000) 2021-08-03T12:17:16.591 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:16.588+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5187 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:16.636 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:16.629+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:16.707 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:16.704+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:16.705355+0000) 2021-08-03T12:17:16.846 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:16.843+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:16.843826+0000) 2021-08-03T12:17:17.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:17.434+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:17.435494+0000) 2021-08-03T12:17:17.708 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:17.705+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:17.706147+0000) 2021-08-03T12:17:17.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:17.876+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:17.877681+0000) 2021-08-03T12:17:17.901 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:17.897+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:17.899004+0000) 2021-08-03T12:17:18.708 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:18.706+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:18.706987+0000) 2021-08-03T12:17:18.934 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:18.930+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:18.931270+0000) 2021-08-03T12:17:18.982 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:18.979+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:18.979903+0000) 2021-08-03T12:17:18.992 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:18.973+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2872 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:19.437 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:19.435+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:19.436025+0000) 2021-08-03T12:17:19.709 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:19.706+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:19.707575+0000) 2021-08-03T12:17:20.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:20.343+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:20.343851+0000) 2021-08-03T12:17:20.710 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:20.707+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:20.708157+0000) 2021-08-03T12:17:21.029 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:21.026+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:21.027634+0000) 2021-08-03T12:17:21.583 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:21.581+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:21.582664+0000) 2021-08-03T12:17:21.710 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:21.708+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:21.708751+0000) 2021-08-03T12:17:21.808 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:21.805+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:21.806524+0000) 2021-08-03T12:17:21.935 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:21.929+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:22.030 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:22.027+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:22.028405+0000) 2021-08-03T12:17:22.584 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:22.582+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:22.582836+0000) 2021-08-03T12:17:22.682 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:22.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:22.681529+0000) 2021-08-03T12:17:22.711 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:22.708+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:22.709348+0000) 2021-08-03T12:17:23.030 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:23.028+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:23.029066+0000) 2021-08-03T12:17:23.574 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:23.547+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5188 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:23.584 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:23.582+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:23.582939+0000) 2021-08-03T12:17:23.631 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:23.628+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:23.629444+0000) 2021-08-03T12:17:23.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:23.654+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:23.655273+0000) 2021-08-03T12:17:23.670 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:23.668+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:23.669098+0000) 2021-08-03T12:17:24.030 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:24.029+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:24.029929+0000) 2021-08-03T12:17:24.196 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:24.195+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:24.196337+0000) 2021-08-03T12:17:24.719 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:24.715+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:24.715943+0000) 2021-08-03T12:17:25.032 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:25.030+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:25.030906+0000) 2021-08-03T12:17:25.099 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:25.095+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:25.096512+0000) 2021-08-03T12:17:25.214 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:25.211+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:25.212241+0000) 2021-08-03T12:17:25.353 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:25.349+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2878 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:26.032 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:26.030+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:26.031513+0000) 2021-08-03T12:17:26.334 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:26.331+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:26.332466+0000) 2021-08-03T12:17:26.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:26.520+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:26.520969+0000) 2021-08-03T12:17:26.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:26.542+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:26.543418+0000) 2021-08-03T12:17:26.620 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:26.616+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:26.617299+0000) 2021-08-03T12:17:27.033 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:27.031+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:27.032150+0000) 2021-08-03T12:17:27.141 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:27.034+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:27.765 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:27.763+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:27.764374+0000) 2021-08-03T12:17:27.958 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:27.953+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:27.954699+0000) 2021-08-03T12:17:28.000 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:27.999+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:28.000081+0000) 2021-08-03T12:17:28.498 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:28.494+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:28.495088+0000) 2021-08-03T12:17:29.000 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:28.999+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:29.000216+0000) 2021-08-03T12:17:29.046 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:29.042+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:29.043674+0000) 2021-08-03T12:17:29.429 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:29.426+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:29.427694+0000) 2021-08-03T12:17:30.000 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:29.999+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:30.000340+0000) 2021-08-03T12:17:30.319 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:30.316+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5189 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:30.664 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:30.661+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:30.662279+0000) 2021-08-03T12:17:31.000 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:30.999+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:31.000497+0000) 2021-08-03T12:17:31.077 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:31.074+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:31.075573+0000) 2021-08-03T12:17:31.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:31.147+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:31.148021+0000) 2021-08-03T12:17:31.479 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:31.477+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:31.478028+0000) 2021-08-03T12:17:32.061 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:32.055+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:32.164 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:32.162+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:32.163193+0000) 2021-08-03T12:17:32.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:32.256+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:32.257515+0000) 2021-08-03T12:17:32.478 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:32.475+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:32.476069+0000) 2021-08-03T12:17:32.974 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:32.972+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:32.973682+0000) 2021-08-03T12:17:33.165 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:33.163+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:33.163863+0000) 2021-08-03T12:17:33.267 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:33.264+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:33.264772+0000) 2021-08-03T12:17:33.600 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:33.597+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:33.598275+0000) 2021-08-03T12:17:33.965 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:33.961+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2884 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:34.166 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:34.163+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:34.164416+0000) 2021-08-03T12:17:35.167 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:35.163+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:35.165139+0000) 2021-08-03T12:17:35.275 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:35.271+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:35.272613+0000) 2021-08-03T12:17:35.524 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:35.519+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:35.521488+0000) 2021-08-03T12:17:35.746 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:35.743+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:35.744156+0000) 2021-08-03T12:17:36.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:36.068+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:36.070297+0000) 2021-08-03T12:17:36.167 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:36.163+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:36.165715+0000) 2021-08-03T12:17:36.333 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:36.330+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:36.332701+0000) 2021-08-03T12:17:36.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:36.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:36.736601+0000) 2021-08-03T12:17:37.168 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:37.164+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:37.166337+0000) 2021-08-03T12:17:37.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:37.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:37.332863+0000) 2021-08-03T12:17:37.407 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:37.405+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:37.406602+0000) 2021-08-03T12:17:37.437 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:37.401+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5200 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:37.486 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:37.457+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6363 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:37.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:37.734+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:37.736785+0000) 2021-08-03T12:17:37.951 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:37.948+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:37.950744+0000) 2021-08-03T12:17:38.169 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:38.165+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.167125+0000) 2021-08-03T12:17:38.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:38.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.333009+0000) 2021-08-03T12:17:38.341 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:38.339+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.339872+0000) 2021-08-03T12:17:38.505 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:38.501+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.502747+0000) 2021-08-03T12:17:38.656 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:38.652+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.654281+0000) 2021-08-03T12:17:38.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:38.735+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.736935+0000) 2021-08-03T12:17:38.884 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:38.881+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.882448+0000) 2021-08-03T12:17:38.919 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:38.914+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:38.916573+0000) 2021-08-03T12:17:39.133 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:39.129+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2906 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:39.169 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:39.166+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:39.167722+0000) 2021-08-03T12:17:39.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:39.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:39.333117+0000) 2021-08-03T12:17:39.420 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:39.417+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:39.418914+0000) 2021-08-03T12:17:39.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:39.735+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:39.737095+0000) 2021-08-03T12:17:40.170 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:40.166+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:40.168328+0000) 2021-08-03T12:17:40.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:40.284+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:40.285928+0000) 2021-08-03T12:17:40.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:40.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:40.333254+0000) 2021-08-03T12:17:40.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:40.735+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:40.737265+0000) 2021-08-03T12:17:41.170 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:41.167+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:41.168890+0000) 2021-08-03T12:17:41.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:41.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:41.333392+0000) 2021-08-03T12:17:41.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:41.735+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:41.737396+0000) 2021-08-03T12:17:41.990 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:41.987+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:41.988222+0000) 2021-08-03T12:17:42.171 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:42.167+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:42.169452+0000) 2021-08-03T12:17:42.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:42.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:42.333508+0000) 2021-08-03T12:17:42.531 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:42.528+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:42.529733+0000) 2021-08-03T12:17:42.537 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:42.533+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:42.535439+0000) 2021-08-03T12:17:42.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:42.735+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:42.737505+0000) 2021-08-03T12:17:42.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:42.745+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:42.747406+0000) 2021-08-03T12:17:42.883 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:42.702+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6366 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:43.171 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:43.168+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:43.170119+0000) 2021-08-03T12:17:43.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:43.331+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:43.333662+0000) 2021-08-03T12:17:43.507 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:43.504+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:43.505297+0000) 2021-08-03T12:17:43.643 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:43.632+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:43.633751+0000) 2021-08-03T12:17:43.657 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:43.654+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:43.656470+0000) 2021-08-03T12:17:43.715 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:43.712+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:43.713369+0000) 2021-08-03T12:17:43.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:43.736+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:43.737634+0000) 2021-08-03T12:17:43.774 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:43.708+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5211 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:44.074 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:44.071+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:44.072426+0000) 2021-08-03T12:17:44.172 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:44.169+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:44.170660+0000) 2021-08-03T12:17:44.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:44.332+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:44.333770+0000) 2021-08-03T12:17:44.716 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:44.713+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:44.714382+0000) 2021-08-03T12:17:44.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:44.736+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:44.737770+0000) 2021-08-03T12:17:45.033 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:45.030+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:45.030906+0000) 2021-08-03T12:17:45.074 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:45.072+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:45.072988+0000) 2021-08-03T12:17:45.173 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:45.170+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:45.171389+0000) 2021-08-03T12:17:45.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:45.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:45.333844+0000) 2021-08-03T12:17:45.423 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:45.421+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:45.422474+0000) 2021-08-03T12:17:45.717 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:45.714+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:45.714927+0000) 2021-08-03T12:17:45.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:45.737+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:45.737920+0000) 2021-08-03T12:17:46.075 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:46.072+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:46.073572+0000) 2021-08-03T12:17:46.116 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:46.074+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2910 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:46.173 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:46.171+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:46.171912+0000) 2021-08-03T12:17:46.227 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:46.224+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:46.225512+0000) 2021-08-03T12:17:46.717 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:46.714+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:46.715514+0000) 2021-08-03T12:17:46.739 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:46.737+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:46.738067+0000) 2021-08-03T12:17:47.076 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:47.073+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:47.074432+0000) 2021-08-03T12:17:47.174 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:47.171+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:47.172475+0000) 2021-08-03T12:17:47.718 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:47.715+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:47.716051+0000) 2021-08-03T12:17:47.729 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:47.727+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:47.728864+0000) 2021-08-03T12:17:47.801 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:47.798+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:47.798892+0000) 2021-08-03T12:17:47.805 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:47.802+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:47.803313+0000) 2021-08-03T12:17:47.912 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:47.910+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:47.911052+0000) 2021-08-03T12:17:48.077 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:48.074+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:48.075003+0000) 2021-08-03T12:17:48.718 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:48.715+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:48.716632+0000) 2021-08-03T12:17:48.822 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:48.818+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:48.819634+0000) 2021-08-03T12:17:48.856 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:48.854+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:48.855494+0000) 2021-08-03T12:17:49.077 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:49.074+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:49.075609+0000) 2021-08-03T12:17:49.249 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:49.125+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5225 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:49.377 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:49.335+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6380 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:49.666 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:49.663+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:49.663947+0000) 2021-08-03T12:17:49.719 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:49.716+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:49.717194+0000) 2021-08-03T12:17:50.078 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:50.075+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:50.076190+0000) 2021-08-03T12:17:50.162 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:50.159+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:50.160159+0000) 2021-08-03T12:17:50.720 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:50.717+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:50.717983+0000) 2021-08-03T12:17:50.865 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:50.861+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:50.862331+0000) 2021-08-03T12:17:51.078 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:51.076+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:51.076735+0000) 2021-08-03T12:17:51.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:51.324+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:51.325482+0000) 2021-08-03T12:17:51.720 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:51.717+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:51.718557+0000) 2021-08-03T12:17:51.874 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:51.872+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:51.873589+0000) 2021-08-03T12:17:51.877 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:51.874+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:51.874841+0000) 2021-08-03T12:17:52.079 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:52.076+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:52.077328+0000) 2021-08-03T12:17:52.358 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:52.356+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:52.357566+0000) 2021-08-03T12:17:52.709 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:17:52.705+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:52.706532+0000) 2021-08-03T12:17:52.721 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:52.718+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:52.719305+0000) 2021-08-03T12:17:52.740 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:52.739+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:52.740276+0000) 2021-08-03T12:17:53.079 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:53.077+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:53.077961+0000) 2021-08-03T12:17:53.517 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:17:53.513+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:53.514255+0000) 2021-08-03T12:17:53.688 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:53.686+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:53.686964+0000) 2021-08-03T12:17:53.722 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:53.719+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:53.720426+0000) 2021-08-03T12:17:54.080 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:54.077+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:54.078541+0000) 2021-08-03T12:17:54.349 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:54.347+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:54.347843+0000) 2021-08-03T12:17:54.658 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:17:54.449+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6380 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:17:54.689 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:54.687+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:54.687970+0000) 2021-08-03T12:17:54.723 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:54.720+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:54.721370+0000) 2021-08-03T12:17:54.982 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:17:54.980+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:54.981820+0000) 2021-08-03T12:17:55.021 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:55.019+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:55.020308+0000) 2021-08-03T12:17:55.082 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:55.079+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:55.080378+0000) 2021-08-03T12:17:55.239 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:55.237+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:55.237841+0000) 2021-08-03T12:17:55.270 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:17:55.265+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5237 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:17:55.428 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:17:55.346+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2920 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:17:55.473 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:17:55.469+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:55.470724+0000) 2021-08-03T12:17:55.724 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:55.721+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:55.722264+0000) 2021-08-03T12:17:56.086 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:56.080+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:56.080954+0000) 2021-08-03T12:17:56.724 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:56.722+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:56.722882+0000) 2021-08-03T12:17:56.940 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:56.938+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:56.938990+0000) 2021-08-03T12:17:57.083 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:57.080+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:57.081567+0000) 2021-08-03T12:17:57.725 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:57.722+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:57.723470+0000) 2021-08-03T12:17:57.879 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:17:57.876+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:57.877718+0000) 2021-08-03T12:17:58.084 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:58.081+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:58.082148+0000) 2021-08-03T12:17:58.725 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:58.723+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:58.723734+0000) 2021-08-03T12:17:58.726 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:58.723+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:58.724030+0000) 2021-08-03T12:17:58.947 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:58.945+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:58.946530+0000) 2021-08-03T12:17:59.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:17:59.072+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:59.073166+0000) 2021-08-03T12:17:59.084 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:17:59.082+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:59.082713+0000) 2021-08-03T12:17:59.726 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:17:59.723+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:59.724609+0000) 2021-08-03T12:17:59.728 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:17:59.723+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:59.724596+0000) 2021-08-03T12:17:59.948 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:17:59.946+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:17:59.947448+0000) 2021-08-03T12:18:00.085 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:00.082+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:00.083330+0000) 2021-08-03T12:18:00.727 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:00.724+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:00.725165+0000) 2021-08-03T12:18:00.727 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:00.724+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:00.725421+0000) 2021-08-03T12:18:00.949 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:00.947+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:00.948320+0000) 2021-08-03T12:18:01.085 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:01.083+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:01.084100+0000) 2021-08-03T12:18:01.728 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:01.725+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:01.726109+0000) 2021-08-03T12:18:01.728 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:01.725+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:01.726103+0000) 2021-08-03T12:18:01.950 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:01.948+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:01.948895+0000) 2021-08-03T12:18:02.001 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:01.999+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:02.000847+0000) 2021-08-03T12:18:02.086 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:02.083+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:02.084645+0000) 2021-08-03T12:18:02.219 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:02.158+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6398 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:02.728 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:02.725+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:02.726682+0000) 2021-08-03T12:18:02.729 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:02.726+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:02.727186+0000) 2021-08-03T12:18:02.771 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:02.770+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:02.771275+0000) 2021-08-03T12:18:02.869 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:02.850+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5264 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:02.951 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:02.948+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:02.949480+0000) 2021-08-03T12:18:03.001 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:03.000+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:03.000974+0000) 2021-08-03T12:18:03.087 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:03.084+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:03.085192+0000) 2021-08-03T12:18:03.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:03.270+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:03.271594+0000) 2021-08-03T12:18:03.729 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:03.726+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:03.727259+0000) 2021-08-03T12:18:03.730 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:03.727+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:03.728190+0000) 2021-08-03T12:18:03.840 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:03.836+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:03.837739+0000) 2021-08-03T12:18:03.951 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:03.949+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:03.949999+0000) 2021-08-03T12:18:04.001 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:04.000+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:04.001076+0000) 2021-08-03T12:18:04.037 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:03.406+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2924 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:04.087 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:04.085+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:04.085739+0000) 2021-08-03T12:18:04.254 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:04.252+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:04.253272+0000) 2021-08-03T12:18:04.509 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:04.507+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:04.508725+0000) 2021-08-03T12:18:04.729 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:04.727+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:04.727993+0000) 2021-08-03T12:18:04.730 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:04.728+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:04.728753+0000) 2021-08-03T12:18:04.952 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:04.949+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:04.950579+0000) 2021-08-03T12:18:05.001 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:05.000+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:05.001232+0000) 2021-08-03T12:18:05.089 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:05.086+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:05.087000+0000) 2021-08-03T12:18:05.511 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:05.508+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:05.509454+0000) 2021-08-03T12:18:05.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:05.646+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:05.646957+0000) 2021-08-03T12:18:05.730 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:05.727+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:05.728599+0000) 2021-08-03T12:18:05.731 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:05.729+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:05.729897+0000) 2021-08-03T12:18:05.952 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:05.950+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:05.951140+0000) 2021-08-03T12:18:06.001 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:06.000+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:06.001370+0000) 2021-08-03T12:18:06.090 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:06.087+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:06.088108+0000) 2021-08-03T12:18:06.511 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:06.509+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:06.510068+0000) 2021-08-03T12:18:06.554 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:06.552+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:06.552885+0000) 2021-08-03T12:18:06.732 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:06.729+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:06.730456+0000) 2021-08-03T12:18:06.953 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:06.950+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:06.951724+0000) 2021-08-03T12:18:07.002 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:07.000+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:07.001510+0000) 2021-08-03T12:18:07.139 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:07.137+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:07.137949+0000) 2021-08-03T12:18:07.512 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:07.509+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:07.510745+0000) 2021-08-03T12:18:07.733 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:07.730+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:07.731051+0000) 2021-08-03T12:18:07.739 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:07.737+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:07.738438+0000) 2021-08-03T12:18:07.953 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:07.951+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:07.952508+0000) 2021-08-03T12:18:07.962 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:07.959+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:07.960161+0000) 2021-08-03T12:18:08.002 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:08.000+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:08.001628+0000) 2021-08-03T12:18:08.080 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:08.077+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:08.078287+0000) 2021-08-03T12:18:08.145 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:08.125+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6409 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:08.191 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:08.123+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5275 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:08.513 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:08.511+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:08.511781+0000) 2021-08-03T12:18:08.733 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:08.730+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:08.731612+0000) 2021-08-03T12:18:08.954 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:08.952+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:08.953111+0000) 2021-08-03T12:18:09.239 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:09.237+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:09.238011+0000) 2021-08-03T12:18:09.614 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:09.511+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:09.512589+0000) 2021-08-03T12:18:09.734 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:09.731+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:09.732315+0000) 2021-08-03T12:18:09.955 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:09.953+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:09.954115+0000) 2021-08-03T12:18:10.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:10.225+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:10.226452+0000) 2021-08-03T12:18:10.514 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:10.512+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:10.513206+0000) 2021-08-03T12:18:10.658 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:10.656+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:10.657878+0000) 2021-08-03T12:18:10.735 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:10.732+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:10.732914+0000) 2021-08-03T12:18:10.956 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:10.954+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:10.955156+0000) 2021-08-03T12:18:11.187 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:11.185+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:11.186180+0000) 2021-08-03T12:18:11.342 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:11.339+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:11.340079+0000) 2021-08-03T12:18:11.515 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:11.513+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:11.514609+0000) 2021-08-03T12:18:11.735 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:11.732+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:11.733685+0000) 2021-08-03T12:18:11.956 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:11.954+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:11.955744+0000) 2021-08-03T12:18:12.217 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:12.198+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2924 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:12.516 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:12.514+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:12.515418+0000) 2021-08-03T12:18:12.736 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:12.733+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:12.734598+0000) 2021-08-03T12:18:12.957 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:12.955+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:12.956320+0000) 2021-08-03T12:18:13.174 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:13.171+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:13.172805+0000) 2021-08-03T12:18:13.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:13.334+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:13.334987+0000) 2021-08-03T12:18:13.517 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:13.515+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:13.515983+0000) 2021-08-03T12:18:13.737 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:13.734+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:13.735524+0000) 2021-08-03T12:18:13.958 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:13.956+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:13.956885+0000) 2021-08-03T12:18:14.518 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:14.515+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:14.516605+0000) 2021-08-03T12:18:14.665 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:14.568+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5296 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:14.730 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:14.694+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6425 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:14.738 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:14.735+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:14.736320+0000) 2021-08-03T12:18:14.959 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:14.957+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:14.957867+0000) 2021-08-03T12:18:15.135 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:15.131+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:15.132015+0000) 2021-08-03T12:18:15.518 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:15.516+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:15.517527+0000) 2021-08-03T12:18:15.624 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:15.621+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:15.622538+0000) 2021-08-03T12:18:15.739 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:15.736+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:15.737139+0000) 2021-08-03T12:18:15.959 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:15.957+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:15.958459+0000) 2021-08-03T12:18:16.118 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:16.117+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.118149+0000) 2021-08-03T12:18:16.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:16.137+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.137825+0000) 2021-08-03T12:18:16.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:16.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.334196+0000) 2021-08-03T12:18:16.519 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:16.517+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.518329+0000) 2021-08-03T12:18:16.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:16.542+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.543700+0000) 2021-08-03T12:18:16.624 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:16.622+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.623083+0000) 2021-08-03T12:18:16.630 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:16.626+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.627611+0000) 2021-08-03T12:18:16.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:16.698+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.698936+0000) 2021-08-03T12:18:16.740 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:16.737+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.737722+0000) 2021-08-03T12:18:16.960 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:16.958+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:16.959265+0000) 2021-08-03T12:18:17.251 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:17.248+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.249336+0000) 2021-08-03T12:18:17.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:17.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.334336+0000) 2021-08-03T12:18:17.520 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:17.518+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.518882+0000) 2021-08-03T12:18:17.559 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:17.555+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.556746+0000) 2021-08-03T12:18:17.561 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:17.559+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.560379+0000) 2021-08-03T12:18:17.625 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:17.622+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.623680+0000) 2021-08-03T12:18:17.740 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:17.737+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.738518+0000) 2021-08-03T12:18:17.962 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:17.958+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:17.960080+0000) 2021-08-03T12:18:18.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:18.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:18.334475+0000) 2021-08-03T12:18:18.520 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:18.517+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:18.519549+0000) 2021-08-03T12:18:18.626 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:18.623+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:18.624256+0000) 2021-08-03T12:18:18.741 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:18.738+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:18.739301+0000) 2021-08-03T12:18:18.962 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:18.958+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:18.960591+0000) 2021-08-03T12:18:19.266 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:19.261+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2924 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:19.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:19.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:19.334627+0000) 2021-08-03T12:18:19.521 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:19.518+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:19.520411+0000) 2021-08-03T12:18:19.626 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:19.624+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:19.624812+0000) 2021-08-03T12:18:19.742 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:19.739+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:19.739991+0000) 2021-08-03T12:18:19.962 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:19.959+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:19.961307+0000) 2021-08-03T12:18:20.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:20.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:20.334759+0000) 2021-08-03T12:18:20.427 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:20.424+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:20.425286+0000) 2021-08-03T12:18:20.522 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:20.519+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:20.521236+0000) 2021-08-03T12:18:20.627 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:20.625+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:20.625846+0000) 2021-08-03T12:18:20.742 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:20.739+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:20.740544+0000) 2021-08-03T12:18:20.825 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:18:20.821+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:20.823170+0000) 2021-08-03T12:18:20.963 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:20.960+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:20.961908+0000) 2021-08-03T12:18:21.273 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:18:21.269+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:21.271297+0000) 2021-08-03T12:18:21.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:21.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:21.334907+0000) 2021-08-03T12:18:21.427 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:21.424+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:21.426001+0000) 2021-08-03T12:18:21.482 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:21.425+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5302 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:21.628 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:21.625+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:21.626752+0000) 2021-08-03T12:18:21.792 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:21.750+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6434 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:22.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:22.333+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:22.335010+0000) 2021-08-03T12:18:23.044 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:23.041+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:23.043561+0000) 2021-08-03T12:18:23.315 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:23.310+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:23.312553+0000) 2021-08-03T12:18:23.634 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:23.630+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:23.632382+0000) 2021-08-03T12:18:23.830 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:23.828+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:23.829983+0000) 2021-08-03T12:18:23.896 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:23.892+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:23.893863+0000) 2021-08-03T12:18:24.584 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:24.581+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:24.583650+0000) 2021-08-03T12:18:24.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:24.606+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:24.608081+0000) 2021-08-03T12:18:24.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:24.656+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:24.658305+0000) 2021-08-03T12:18:24.692 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:24.687+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:24.689708+0000) 2021-08-03T12:18:25.071 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:25.067+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:25.069255+0000) 2021-08-03T12:18:25.423 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:25.418+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:25.420344+0000) 2021-08-03T12:18:25.585 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:25.581+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:25.583807+0000) 2021-08-03T12:18:25.662 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:25.659+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:25.660832+0000) 2021-08-03T12:18:25.695 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:25.693+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:25.693984+0000) 2021-08-03T12:18:25.890 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:25.808+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2924 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:26.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:26.541+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:26.542843+0000) 2021-08-03T12:18:26.585 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:26.582+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:26.583952+0000) 2021-08-03T12:18:26.664 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:26.660+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:26.661972+0000) 2021-08-03T12:18:26.695 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:26.693+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:26.694703+0000) 2021-08-03T12:18:27.585 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:27.582+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:27.584087+0000) 2021-08-03T12:18:27.663 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:27.660+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:27.662093+0000) 2021-08-03T12:18:27.696 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:27.694+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:27.695323+0000) 2021-08-03T12:18:27.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:27.725+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:27.727273+0000) 2021-08-03T12:18:28.496 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:28.492+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:28.494423+0000) 2021-08-03T12:18:28.620 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:28.617+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:28.618126+0000) 2021-08-03T12:18:28.697 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:28.695+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:28.696158+0000) 2021-08-03T12:18:28.739 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:28.546+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5326 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:28.739 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:28.737+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:28.738794+0000) 2021-08-03T12:18:29.317 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:29.312+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6457 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:29.327 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:18:29.324+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:29.324939+0000) 2021-08-03T12:18:29.328 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:29.326+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:29.327195+0000) 2021-08-03T12:18:29.497 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:29.493+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:29.495288+0000) 2021-08-03T12:18:29.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:29.506+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:29.508609+0000) 2021-08-03T12:18:29.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:29.578+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:29.579888+0000) 2021-08-03T12:18:29.698 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:29.695+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:29.696643+0000) 2021-08-03T12:18:29.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:29.737+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:29.738909+0000) 2021-08-03T12:18:30.170 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:30.166+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:30.167326+0000) 2021-08-03T12:18:30.422 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:30.420+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:30.421643+0000) 2021-08-03T12:18:30.498 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:30.495+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:30.496235+0000) 2021-08-03T12:18:30.698 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:30.696+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:30.697492+0000) 2021-08-03T12:18:30.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:30.738+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:30.739007+0000) 2021-08-03T12:18:31.523 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:31.519+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:31.520685+0000) 2021-08-03T12:18:31.699 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:31.697+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:31.698145+0000) 2021-08-03T12:18:31.739 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:31.736+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:31.736903+0000) 2021-08-03T12:18:31.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:31.738+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:31.739126+0000) 2021-08-03T12:18:31.846 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:31.842+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:31.843629+0000) 2021-08-03T12:18:31.850 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:31.847+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:31.848114+0000) 2021-08-03T12:18:32.523 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:32.520+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:32.521408+0000) 2021-08-03T12:18:32.700 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:32.697+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:32.698734+0000) 2021-08-03T12:18:32.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:32.738+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:32.739286+0000) 2021-08-03T12:18:33.523 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:33.521+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:33.521945+0000) 2021-08-03T12:18:33.700 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:33.699+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:33.699867+0000) 2021-08-03T12:18:33.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:33.738+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:33.739391+0000) 2021-08-03T12:18:34.046 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:34.041+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2924 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:34.104 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:34.100+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:34.101732+0000) 2021-08-03T12:18:34.524 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:34.521+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:34.522694+0000) 2021-08-03T12:18:34.702 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:34.699+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:34.700448+0000) 2021-08-03T12:18:34.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:34.738+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:34.739540+0000) 2021-08-03T12:18:35.300 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:35.297+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:35.298749+0000) 2021-08-03T12:18:35.525 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:35.522+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:35.523250+0000) 2021-08-03T12:18:35.702 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:35.700+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:35.701016+0000) 2021-08-03T12:18:35.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:35.738+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:35.739669+0000) 2021-08-03T12:18:35.765 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:35.762+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:35.762743+0000) 2021-08-03T12:18:35.897 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:35.893+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5333 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:36.300 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:36.298+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:36.299512+0000) 2021-08-03T12:18:36.394 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:36.390+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:36.526 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:36.523+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:36.523999+0000) 2021-08-03T12:18:36.765 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:36.762+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:36.763480+0000) 2021-08-03T12:18:36.795 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:36.793+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:36.794759+0000) 2021-08-03T12:18:37.527 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:37.523+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:37.524545+0000) 2021-08-03T12:18:37.765 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:37.763+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:37.764072+0000) 2021-08-03T12:18:38.251 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:38.248+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:38.249710+0000) 2021-08-03T12:18:38.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:38.406+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:38.407106+0000) 2021-08-03T12:18:38.527 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:38.524+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:38.525346+0000) 2021-08-03T12:18:39.002 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:39.001+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:39.002169+0000) 2021-08-03T12:18:39.252 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:39.249+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:39.250288+0000) 2021-08-03T12:18:39.527 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:39.525+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:39.525914+0000) 2021-08-03T12:18:39.551 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:39.548+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:39.549333+0000) 2021-08-03T12:18:39.673 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:18:39.670+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:39.671700+0000) 2021-08-03T12:18:39.869 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:39.567+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2935 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:40.003 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:40.001+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:40.002320+0000) 2021-08-03T12:18:40.253 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:40.250+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:40.251035+0000) 2021-08-03T12:18:40.511 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:40.508+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:40.509479+0000) 2021-08-03T12:18:40.528 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:40.526+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:40.526933+0000) 2021-08-03T12:18:40.546 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:40.544+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:40.545468+0000) 2021-08-03T12:18:40.584 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:40.580+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:40.580990+0000) 2021-08-03T12:18:40.872 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:40.870+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:40.871667+0000) 2021-08-03T12:18:41.002 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:41.001+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:41.002466+0000) 2021-08-03T12:18:41.192 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:41.188+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:41.189547+0000) 2021-08-03T12:18:41.253 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:41.251+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:41.251735+0000) 2021-08-03T12:18:41.302 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:41.300+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:41.300997+0000) 2021-08-03T12:18:41.527 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:41.525+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:41.526612+0000) 2021-08-03T12:18:41.529 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:41.526+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:41.527528+0000) 2021-08-03T12:18:42.003 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:42.001+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:42.002608+0000) 2021-08-03T12:18:42.254 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:42.251+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:42.252354+0000) 2021-08-03T12:18:42.529 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:42.527+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:42.528464+0000) 2021-08-03T12:18:42.530 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:42.527+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:42.528142+0000) 2021-08-03T12:18:42.756 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:42.547+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5345 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:42.921 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:42.808+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6473 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:43.003 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:43.001+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:43.002747+0000) 2021-08-03T12:18:43.111 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:43.109+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:43.109939+0000) 2021-08-03T12:18:43.530 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:43.527+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:43.528668+0000) 2021-08-03T12:18:44.355 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:44.352+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:44.353097+0000) 2021-08-03T12:18:44.666 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:18:44.663+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:44.664319+0000) 2021-08-03T12:18:45.075 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:45.072+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:45.073464+0000) 2021-08-03T12:18:45.076 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:45.072+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:45.072795+0000) 2021-08-03T12:18:45.573 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:45.570+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:45.570818+0000) 2021-08-03T12:18:45.801 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:45.800+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:45.801585+0000) 2021-08-03T12:18:46.416 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:46.286+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2935 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:46.697 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:46.693+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:46.694464+0000) 2021-08-03T12:18:47.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:47.651+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:47.652688+0000) 2021-08-03T12:18:47.963 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:47.960+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:47.960913+0000) 2021-08-03T12:18:48.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:48.256+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:48.257677+0000) 2021-08-03T12:18:48.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:48.572+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:48.573423+0000) 2021-08-03T12:18:49.137 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:49.088+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6478 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:49.633 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:49.631+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:49.632420+0000) 2021-08-03T12:18:50.015 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:49.629+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5350 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:50.185 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:50.182+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:50.183252+0000) 2021-08-03T12:18:50.797 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:50.796+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:50.797546+0000) 2021-08-03T12:18:51.129 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:51.126+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:51.127169+0000) 2021-08-03T12:18:51.285 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:51.282+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:51.283673+0000) 2021-08-03T12:18:51.524 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:51.521+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:51.521896+0000) 2021-08-03T12:18:52.043 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:52.039+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:52.040722+0000) 2021-08-03T12:18:52.103 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:52.100+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:52.101033+0000) 2021-08-03T12:18:52.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:52.247+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:52.248333+0000) 2021-08-03T12:18:52.286 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:52.283+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:52.284685+0000) 2021-08-03T12:18:52.754 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:18:52.750+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:52.751720+0000) 2021-08-03T12:18:52.801 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:52.798+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:52.798824+0000) 2021-08-03T12:18:52.859 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:18:52.802+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2937 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:18:53.103 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:53.100+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:53.101576+0000) 2021-08-03T12:18:53.287 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:53.284+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:53.285366+0000) 2021-08-03T12:18:53.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:53.334+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:53.335474+0000) 2021-08-03T12:18:53.616 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:53.614+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:53.615009+0000) 2021-08-03T12:18:54.104 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:54.101+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:54.102149+0000) 2021-08-03T12:18:54.289 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:54.287+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:54.287995+0000) 2021-08-03T12:18:54.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:54.334+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:54.335610+0000) 2021-08-03T12:18:54.859 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:18:54.856+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:54.857513+0000) 2021-08-03T12:18:55.104 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:55.101+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:55.102726+0000) 2021-08-03T12:18:55.290 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:55.287+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:55.288564+0000) 2021-08-03T12:18:55.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:55.334+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:55.335776+0000) 2021-08-03T12:18:56.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:18:56.046+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5371 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:18:56.105 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:56.102+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.103494+0000) 2021-08-03T12:18:56.274 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:56.272+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.272824+0000) 2021-08-03T12:18:56.307 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:56.305+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.306431+0000) 2021-08-03T12:18:56.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:56.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.335908+0000) 2021-08-03T12:18:56.391 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:18:56.321+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6486 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:18:56.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:56.430+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.431507+0000) 2021-08-03T12:18:56.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:56.644+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.645804+0000) 2021-08-03T12:18:56.741 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:56.739+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.740092+0000) 2021-08-03T12:18:56.781 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:18:56.778+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:56.778813+0000) 2021-08-03T12:18:57.158 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:18:57.155+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:57.156122+0000) 2021-08-03T12:18:57.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:57.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:57.336019+0000) 2021-08-03T12:18:57.413 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:18:57.411+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:57.412539+0000) 2021-08-03T12:18:57.563 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:18:57.560+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:57.560828+0000) 2021-08-03T12:18:57.584 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:18:57.581+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:57.581769+0000) 2021-08-03T12:18:57.741 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:57.739+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:57.740229+0000) 2021-08-03T12:18:58.171 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:18:58.168+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:58.169553+0000) 2021-08-03T12:18:58.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:58.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:58.336155+0000) 2021-08-03T12:18:58.411 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:18:58.407+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:58.408260+0000) 2021-08-03T12:18:58.429 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T12:18:58.427+0000 7f57d57e4700 0 -- 172.21.15.3:0/3813029560 >> [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] conn(0x7f57b00060c0 msgr2=0x7f57b4062520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-03T12:18:58.585 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:58.583+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:58.584442+0000) 2021-08-03T12:18:58.663 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:58.661+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:58.662480+0000) 2021-08-03T12:18:58.741 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:58.739+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:58.740353+0000) 2021-08-03T12:18:59.076 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:18:59.073+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:59.074312+0000) 2021-08-03T12:18:59.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:59.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:59.336295+0000) 2021-08-03T12:18:59.585 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:59.583+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:59.584567+0000) 2021-08-03T12:18:59.741 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:18:59.739+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:18:59.740459+0000) 2021-08-03T12:19:00.069 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:00.064+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2937 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:00.138 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:00.135+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:00.135926+0000) 2021-08-03T12:19:00.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:00.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:00.336437+0000) 2021-08-03T12:19:00.586 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:00.583+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:00.584702+0000) 2021-08-03T12:19:00.741 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:00.739+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:00.740581+0000) 2021-08-03T12:19:00.940 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:00.938+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:00.939362+0000) 2021-08-03T12:19:01.138 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:01.136+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:01.136727+0000) 2021-08-03T12:19:01.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:01.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:01.336564+0000) 2021-08-03T12:19:01.586 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:01.584+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:01.584850+0000) 2021-08-03T12:19:01.742 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:01.739+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:01.740707+0000) 2021-08-03T12:19:02.139 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:02.136+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:02.137371+0000) 2021-08-03T12:19:02.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:02.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:02.336695+0000) 2021-08-03T12:19:02.586 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:02.584+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:02.585001+0000) 2021-08-03T12:19:02.742 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:02.740+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:02.740840+0000) 2021-08-03T12:19:03.044 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:03.041+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:03.042159+0000) 2021-08-03T12:19:03.140 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:03.137+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:03.138688+0000) 2021-08-03T12:19:03.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:03.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:03.336859+0000) 2021-08-03T12:19:03.354 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:03.286+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6513 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:03.536 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:03.534+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:03.535323+0000) 2021-08-03T12:19:03.761 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:03.649+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5376 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:03.922 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:03.920+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:03.921138+0000) 2021-08-03T12:19:04.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:04.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:04.336985+0000) 2021-08-03T12:19:04.620 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:04.616+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:04.617632+0000) 2021-08-03T12:19:04.853 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:04.851+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:04.852715+0000) 2021-08-03T12:19:05.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:05.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:05.337081+0000) 2021-08-03T12:19:06.069 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:06.065+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.066678+0000) 2021-08-03T12:19:06.098 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:06.095+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.096086+0000) 2021-08-03T12:19:06.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:06.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.337213+0000) 2021-08-03T12:19:06.340 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:06.338+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.339031+0000) 2021-08-03T12:19:06.341 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:06.337+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.338431+0000) 2021-08-03T12:19:06.537 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:06.535+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.536012+0000) 2021-08-03T12:19:06.936 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:06.932+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.933375+0000) 2021-08-03T12:19:06.992 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:06.989+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:06.989804+0000) 2021-08-03T12:19:07.247 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:07.244+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:07.245043+0000) 2021-08-03T12:19:07.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:07.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:07.337339+0000) 2021-08-03T12:19:07.792 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:07.199+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2939 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:07.908 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:07.905+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:07.906218+0000) 2021-08-03T12:19:08.190 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:08.186+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:08.188654+0000) 2021-08-03T12:19:08.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:08.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:08.337527+0000) 2021-08-03T12:19:08.600 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:08.595+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:08.596947+0000) 2021-08-03T12:19:09.191 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:09.187+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:09.189368+0000) 2021-08-03T12:19:09.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:09.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:09.337631+0000) 2021-08-03T12:19:09.417 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:09.137+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5386 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:09.561 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:09.558+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:09.559893+0000) 2021-08-03T12:19:09.708 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:09.673+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6517 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:10.192 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:10.188+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:10.189899+0000) 2021-08-03T12:19:10.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:10.335+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:10.337766+0000) 2021-08-03T12:19:10.442 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:10.438+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:10.440156+0000) 2021-08-03T12:19:10.642 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:10.639+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:10.640339+0000) 2021-08-03T12:19:11.084 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:11.081+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:11.082277+0000) 2021-08-03T12:19:11.192 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:11.188+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:11.190435+0000) 2021-08-03T12:19:11.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:11.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:11.337899+0000) 2021-08-03T12:19:11.442 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:11.439+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:11.440867+0000) 2021-08-03T12:19:11.648 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:11.643+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:11.644072+0000) 2021-08-03T12:19:12.192 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:12.189+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:12.190992+0000) 2021-08-03T12:19:12.291 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:12.288+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:12.289445+0000) 2021-08-03T12:19:12.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:12.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:12.338036+0000) 2021-08-03T12:19:12.443 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:12.439+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:12.441479+0000) 2021-08-03T12:19:12.453 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:12.447+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:12.449209+0000) 2021-08-03T12:19:12.646 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:12.644+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:12.645532+0000) 2021-08-03T12:19:13.193 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:13.189+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:13.191525+0000) 2021-08-03T12:19:13.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:13.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:13.338177+0000) 2021-08-03T12:19:13.445 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:13.441+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:13.443435+0000) 2021-08-03T12:19:13.647 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:13.645+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:13.646355+0000) 2021-08-03T12:19:14.003 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:14.002+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:14.003162+0000) 2021-08-03T12:19:14.194 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:14.190+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:14.192079+0000) 2021-08-03T12:19:14.272 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:14.268+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:14.269857+0000) 2021-08-03T12:19:14.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:14.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:14.338359+0000) 2021-08-03T12:19:14.447 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:14.443+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:14.445541+0000) 2021-08-03T12:19:14.648 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:14.646+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:14.646956+0000) 2021-08-03T12:19:15.003 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:15.001+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:15.003310+0000) 2021-08-03T12:19:15.164 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:15.017+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2943 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:15.194 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:15.190+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:15.192658+0000) 2021-08-03T12:19:15.272 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:15.268+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:15.270640+0000) 2021-08-03T12:19:15.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:15.336+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:15.338498+0000) 2021-08-03T12:19:15.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:15.410+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:15.412142+0000) 2021-08-03T12:19:15.448 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:15.444+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:15.446135+0000) 2021-08-03T12:19:15.606 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:15.465+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5392 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:15.648 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:15.645+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:15.647524+0000) 2021-08-03T12:19:16.004 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:16.001+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:16.003444+0000) 2021-08-03T12:19:16.196 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:16.192+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:16.193561+0000) 2021-08-03T12:19:16.264 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:16.261+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:16.261950+0000) 2021-08-03T12:19:16.273 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:16.270+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:16.271308+0000) 2021-08-03T12:19:16.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:16.337+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:16.338635+0000) 2021-08-03T12:19:16.449 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:16.446+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:16.446931+0000) 2021-08-03T12:19:16.649 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:16.646+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:16.648210+0000) 2021-08-03T12:19:17.196 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:17.193+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:17.194102+0000) 2021-08-03T12:19:17.273 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:17.271+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:17.271937+0000) 2021-08-03T12:19:17.340 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:17.337+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:17.338781+0000) 2021-08-03T12:19:17.432 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:17.429+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6522 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:17.449 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:17.446+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:17.447526+0000) 2021-08-03T12:19:17.650 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:17.647+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:17.648798+0000) 2021-08-03T12:19:18.196 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:18.193+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:18.194661+0000) 2021-08-03T12:19:18.274 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:18.271+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:18.272560+0000) 2021-08-03T12:19:18.324 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:18.322+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:18.323769+0000) 2021-08-03T12:19:18.340 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:18.338+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:18.338918+0000) 2021-08-03T12:19:18.450 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:18.447+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:18.448136+0000) 2021-08-03T12:19:18.533 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:18.528+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:18.530336+0000) 2021-08-03T12:19:18.651 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:18.647+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:18.649381+0000) 2021-08-03T12:19:19.197 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:19.194+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:19.195332+0000) 2021-08-03T12:19:19.275 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:19.272+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:19.273394+0000) 2021-08-03T12:19:19.340 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:19.338+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:19.339016+0000) 2021-08-03T12:19:19.450 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:19.448+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:19.448732+0000) 2021-08-03T12:19:19.651 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:19.648+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:19.650189+0000) 2021-08-03T12:19:19.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:19.875+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:19.875890+0000) 2021-08-03T12:19:20.197 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:20.195+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:20.195904+0000) 2021-08-03T12:19:20.278 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:20.273+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:20.274417+0000) 2021-08-03T12:19:20.341 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:20.338+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:20.339151+0000) 2021-08-03T12:19:20.451 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:20.448+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:20.449344+0000) 2021-08-03T12:19:20.652 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:20.650+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:20.651025+0000) 2021-08-03T12:19:20.835 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:20.833+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:20.834214+0000) 2021-08-03T12:19:20.927 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:20.924+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:20.925203+0000) 2021-08-03T12:19:21.198 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:21.195+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:21.196477+0000) 2021-08-03T12:19:21.277 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:21.274+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:21.275246+0000) 2021-08-03T12:19:21.454 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:21.449+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:21.450146+0000) 2021-08-03T12:19:21.653 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:21.650+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:21.651725+0000) 2021-08-03T12:19:21.836 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:21.834+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:21.834912+0000) 2021-08-03T12:19:21.928 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:21.925+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:21.925920+0000) 2021-08-03T12:19:22.199 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:22.196+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:22.197078+0000) 2021-08-03T12:19:22.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:22.252+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:22.253782+0000) 2021-08-03T12:19:22.277 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:22.275+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:22.275860+0000) 2021-08-03T12:19:22.299 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:22.296+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:22.297385+0000) 2021-08-03T12:19:22.454 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:22.450+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:22.450748+0000) 2021-08-03T12:19:22.607 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:22.472+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2943 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:22.653 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:22.651+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:22.652360+0000) 2021-08-03T12:19:22.761 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:22.464+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5424 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:22.957 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:22.955+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:22.956844+0000) 2021-08-03T12:19:23.200 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:23.197+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:23.197898+0000) 2021-08-03T12:19:23.278 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:23.275+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:23.276452+0000) 2021-08-03T12:19:23.453 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:23.450+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:23.451388+0000) 2021-08-03T12:19:23.655 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:23.652+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:23.653260+0000) 2021-08-03T12:19:23.742 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:23.740+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:23.741184+0000) 2021-08-03T12:19:23.790 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:23.786+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:23.787665+0000) 2021-08-03T12:19:24.000 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:23.996+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:23.997242+0000) 2021-08-03T12:19:24.169 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:24.074+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6531 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:24.200 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:24.197+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:24.198545+0000) 2021-08-03T12:19:24.278 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:24.276+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:24.277071+0000) 2021-08-03T12:19:24.453 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:24.451+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:24.451927+0000) 2021-08-03T12:19:24.541 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:24.539+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:24.539946+0000) 2021-08-03T12:19:24.655 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:24.653+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:24.654315+0000) 2021-08-03T12:19:24.742 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:24.740+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:24.741357+0000) 2021-08-03T12:19:25.201 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:25.198+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:25.199307+0000) 2021-08-03T12:19:25.279 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:25.277+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:25.277725+0000) 2021-08-03T12:19:25.454 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:25.451+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:25.452521+0000) 2021-08-03T12:19:25.543 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:25.541+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:25.541962+0000) 2021-08-03T12:19:25.656 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:25.654+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:25.654922+0000) 2021-08-03T12:19:26.202 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:26.199+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:26.199994+0000) 2021-08-03T12:19:26.280 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:26.277+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:26.278522+0000) 2021-08-03T12:19:26.372 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:26.370+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:26.371597+0000) 2021-08-03T12:19:26.455 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:26.452+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:26.453306+0000) 2021-08-03T12:19:26.544 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:26.541+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:26.542566+0000) 2021-08-03T12:19:26.657 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:26.654+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:26.655548+0000) 2021-08-03T12:19:26.713 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:26.710+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:26.710902+0000) 2021-08-03T12:19:27.202 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:27.199+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.200524+0000) 2021-08-03T12:19:27.281 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:27.278+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.279293+0000) 2021-08-03T12:19:27.431 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:27.429+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.430245+0000) 2021-08-03T12:19:27.456 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:27.453+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.453907+0000) 2021-08-03T12:19:27.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:27.507+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.508224+0000) 2021-08-03T12:19:27.544 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:27.542+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.543421+0000) 2021-08-03T12:19:27.657 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:27.655+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.656370+0000) 2021-08-03T12:19:27.713 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:27.710+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:27.711653+0000) 2021-08-03T12:19:28.203 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:28.200+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:28.201128+0000) 2021-08-03T12:19:28.281 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:28.279+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:28.279927+0000) 2021-08-03T12:19:28.456 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:28.453+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:28.454476+0000) 2021-08-03T12:19:28.545 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:28.543+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:28.544229+0000) 2021-08-03T12:19:28.658 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:28.656+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:28.656956+0000) 2021-08-03T12:19:28.714 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:28.711+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:28.712453+0000) 2021-08-03T12:19:28.807 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:28.805+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:28.805936+0000) 2021-08-03T12:19:29.204 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:29.201+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:29.202042+0000) 2021-08-03T12:19:29.282 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:29.279+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:29.280523+0000) 2021-08-03T12:19:29.457 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:29.454+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:29.455265+0000) 2021-08-03T12:19:29.547 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:29.544+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:29.545372+0000) 2021-08-03T12:19:29.557 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:29.136+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5447 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:29.658 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:29.656+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:29.657558+0000) 2021-08-03T12:19:29.666 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:29.664+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:29.665401+0000) 2021-08-03T12:19:29.714 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:29.712+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:29.713078+0000) 2021-08-03T12:19:30.064 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:30.060+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.060803+0000) 2021-08-03T12:19:30.205 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:30.202+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.202750+0000) 2021-08-03T12:19:30.283 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:30.280+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.281097+0000) 2021-08-03T12:19:30.458 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:30.455+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.455875+0000) 2021-08-03T12:19:30.547 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:30.545+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.546001+0000) 2021-08-03T12:19:30.659 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:30.657+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.658138+0000) 2021-08-03T12:19:30.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:30.668+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.669026+0000) 2021-08-03T12:19:30.715 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:30.713+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:30.713936+0000) 2021-08-03T12:19:31.086 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:31.031+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2943 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:31.206 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:31.202+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.203382+0000) 2021-08-03T12:19:31.284 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:31.281+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.281913+0000) 2021-08-03T12:19:31.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:31.436+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.437714+0000) 2021-08-03T12:19:31.458 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:31.455+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.456565+0000) 2021-08-03T12:19:31.549 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:31.546+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.547365+0000) 2021-08-03T12:19:31.660 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:31.658+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.659069+0000) 2021-08-03T12:19:31.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:31.670+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.670992+0000) 2021-08-03T12:19:31.716 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:31.713+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:31.714506+0000) 2021-08-03T12:19:32.206 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:32.203+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:32.203993+0000) 2021-08-03T12:19:32.284 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:32.281+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:32.282518+0000) 2021-08-03T12:19:32.461 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:32.456+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:32.457286+0000) 2021-08-03T12:19:32.514 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:32.400+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6557 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:32.550 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:32.547+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:32.548493+0000) 2021-08-03T12:19:32.661 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:32.658+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:32.659661+0000) 2021-08-03T12:19:32.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:32.670+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:32.671219+0000) 2021-08-03T12:19:32.716 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:32.714+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:32.715071+0000) 2021-08-03T12:19:33.057 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:33.054+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.054829+0000) 2021-08-03T12:19:33.207 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:33.204+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.204788+0000) 2021-08-03T12:19:33.285 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:33.282+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.283356+0000) 2021-08-03T12:19:33.459 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:33.457+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.457853+0000) 2021-08-03T12:19:33.551 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:33.548+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.549549+0000) 2021-08-03T12:19:33.586 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:33.584+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.585307+0000) 2021-08-03T12:19:33.661 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:33.659+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.660423+0000) 2021-08-03T12:19:33.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:33.670+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.671365+0000) 2021-08-03T12:19:33.717 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:33.714+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:33.715675+0000) 2021-08-03T12:19:34.057 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:34.054+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.055514+0000) 2021-08-03T12:19:34.207 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:34.204+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.205404+0000) 2021-08-03T12:19:34.288 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:34.283+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.284022+0000) 2021-08-03T12:19:34.363 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:34.360+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.361251+0000) 2021-08-03T12:19:34.460 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:34.457+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.458435+0000) 2021-08-03T12:19:34.552 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:34.549+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.550164+0000) 2021-08-03T12:19:34.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:34.584+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.585464+0000) 2021-08-03T12:19:34.662 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:34.660+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.661405+0000) 2021-08-03T12:19:34.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:34.670+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.671556+0000) 2021-08-03T12:19:34.673 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:34.672+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.672853+0000) 2021-08-03T12:19:34.717 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:34.715+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:34.716273+0000) 2021-08-03T12:19:35.057 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:35.055+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.056069+0000) 2021-08-03T12:19:35.208 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:35.205+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.206014+0000) 2021-08-03T12:19:35.461 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:35.458+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.459309+0000) 2021-08-03T12:19:35.552 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:35.550+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.551189+0000) 2021-08-03T12:19:35.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:35.584+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.585576+0000) 2021-08-03T12:19:35.663 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:35.661+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.662206+0000) 2021-08-03T12:19:35.674 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:35.672+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.672977+0000) 2021-08-03T12:19:35.718 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:35.716+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:35.717084+0000) 2021-08-03T12:19:36.058 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:36.055+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.056635+0000) 2021-08-03T12:19:36.104 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:36.101+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.101746+0000) 2021-08-03T12:19:36.209 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:36.205+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.206633+0000) 2021-08-03T12:19:36.236 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:36.149+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2943 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:36.336 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:36.240+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5461 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:36.462 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:36.459+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.460087+0000) 2021-08-03T12:19:36.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:36.584+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.585707+0000) 2021-08-03T12:19:36.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:36.644+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.645750+0000) 2021-08-03T12:19:36.664 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:36.661+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.662776+0000) 2021-08-03T12:19:36.674 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:36.672+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.673093+0000) 2021-08-03T12:19:36.722 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:36.716+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:36.717703+0000) 2021-08-03T12:19:37.059 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:37.056+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:37.057418+0000) 2021-08-03T12:19:37.209 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:37.206+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:37.207216+0000) 2021-08-03T12:19:37.462 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:37.459+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:37.460699+0000) 2021-08-03T12:19:37.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:37.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:37.585869+0000) 2021-08-03T12:19:37.657 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:37.655+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:37.656411+0000) 2021-08-03T12:19:37.665 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:37.662+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:37.663728+0000) 2021-08-03T12:19:38.018 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:38.015+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:38.016058+0000) 2021-08-03T12:19:38.019 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:38.013+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:38.014140+0000) 2021-08-03T12:19:38.212 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:38.207+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:38.207834+0000) 2021-08-03T12:19:38.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:38.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:38.585996+0000) 2021-08-03T12:19:38.665 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:38.663+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:38.664355+0000) 2021-08-03T12:19:38.788 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:38.786+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:38.786844+0000) 2021-08-03T12:19:39.375 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:39.373+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:39.374620+0000) 2021-08-03T12:19:39.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:39.539+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:39.540309+0000) 2021-08-03T12:19:39.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:39.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:39.586128+0000) 2021-08-03T12:19:39.667 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:39.664+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:39.664968+0000) 2021-08-03T12:19:39.733 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:39.342+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6565 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:39.789 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:39.786+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:39.787412+0000) 2021-08-03T12:19:39.978 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:39.974+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:39.975317+0000) 2021-08-03T12:19:40.264 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:40.259+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:40.259820+0000) 2021-08-03T12:19:40.268 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:40.262+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:40.263319+0000) 2021-08-03T12:19:40.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:40.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:40.586270+0000) 2021-08-03T12:19:40.669 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:40.664+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:40.665540+0000) 2021-08-03T12:19:40.789 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:40.787+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:40.787933+0000) 2021-08-03T12:19:41.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:41.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:41.586403+0000) 2021-08-03T12:19:41.790 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:41.787+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:41.788492+0000) 2021-08-03T12:19:42.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:42.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:42.586507+0000) 2021-08-03T12:19:42.791 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:42.788+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:42.789249+0000) 2021-08-03T12:19:42.980 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:42.976+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:42.977780+0000) 2021-08-03T12:19:43.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:43.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:43.586667+0000) 2021-08-03T12:19:43.738 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:43.637+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5468 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:43.792 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:43.789+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:43.789826+0000) 2021-08-03T12:19:43.986 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:43.985+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:43.986071+0000) 2021-08-03T12:19:44.468 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:44.198+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2946 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:44.494 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:44.492+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:44.493018+0000) 2021-08-03T12:19:44.516 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:44.512+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:44.513519+0000) 2021-08-03T12:19:44.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:44.585+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:44.586796+0000) 2021-08-03T12:19:44.792 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:44.789+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:44.790397+0000) 2021-08-03T12:19:45.182 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:45.179+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6580 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:45.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:45.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:45.586937+0000) 2021-08-03T12:19:45.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:45.740+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:45.741720+0000) 2021-08-03T12:19:45.793 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:45.790+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:45.791102+0000) 2021-08-03T12:19:46.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:46.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:46.587040+0000) 2021-08-03T12:19:46.596 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:46.593+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:46.594597+0000) 2021-08-03T12:19:46.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:46.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:46.741853+0000) 2021-08-03T12:19:46.793 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:46.790+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:46.791659+0000) 2021-08-03T12:19:47.004 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:47.003+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.003875+0000) 2021-08-03T12:19:47.274 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:47.270+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.271673+0000) 2021-08-03T12:19:47.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:47.366+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.367198+0000) 2021-08-03T12:19:47.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:47.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.587174+0000) 2021-08-03T12:19:47.596 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:47.594+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.595198+0000) 2021-08-03T12:19:47.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:47.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.741984+0000) 2021-08-03T12:19:47.794 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:47.791+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.792252+0000) 2021-08-03T12:19:47.961 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:47.957+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:47.958251+0000) 2021-08-03T12:19:48.004 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:48.003+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:48.004035+0000) 2021-08-03T12:19:48.187 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:48.185+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:48.185924+0000) 2021-08-03T12:19:48.512 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:48.509+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:48.510432+0000) 2021-08-03T12:19:48.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:48.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:48.587303+0000) 2021-08-03T12:19:48.597 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:48.594+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:48.595792+0000) 2021-08-03T12:19:48.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:48.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:48.742096+0000) 2021-08-03T12:19:48.795 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:48.792+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:48.792841+0000) 2021-08-03T12:19:49.004 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:49.003+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.004167+0000) 2021-08-03T12:19:49.188 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:49.185+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.186536+0000) 2021-08-03T12:19:49.284 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:49.282+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.282835+0000) 2021-08-03T12:19:49.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:49.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.587445+0000) 2021-08-03T12:19:49.598 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:49.595+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.596401+0000) 2021-08-03T12:19:49.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:49.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.742238+0000) 2021-08-03T12:19:49.750 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:19:49.746+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.747393+0000) 2021-08-03T12:19:49.893 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:49.888+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:49.889195+0000) 2021-08-03T12:19:50.005 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:50.003+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:50.004319+0000) 2021-08-03T12:19:50.189 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:50.186+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:50.187131+0000) 2021-08-03T12:19:50.599 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:50.596+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:50.597212+0000) 2021-08-03T12:19:50.662 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:50.420+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5472 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:50.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:50.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:50.742370+0000) 2021-08-03T12:19:50.893 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:50.890+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:50.891314+0000) 2021-08-03T12:19:51.005 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:51.003+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:51.004489+0000) 2021-08-03T12:19:51.123 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:51.120+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:51.121181+0000) 2021-08-03T12:19:51.189 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:51.187+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:51.187738+0000) 2021-08-03T12:19:51.190 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:51.120+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2951 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:51.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:51.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:51.742477+0000) 2021-08-03T12:19:51.786 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:51.783+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:51.783758+0000) 2021-08-03T12:19:51.893 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:51.891+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:51.891892+0000) 2021-08-03T12:19:52.005 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:52.003+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:52.004629+0000) 2021-08-03T12:19:52.082 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:52.080+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:52.081485+0000) 2021-08-03T12:19:52.190 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:52.187+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:52.188341+0000) 2021-08-03T12:19:52.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:52.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:52.742663+0000) 2021-08-03T12:19:52.842 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:52.839+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:52.840709+0000) 2021-08-03T12:19:52.898 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:52.738+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:53.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:53.188+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:53.189170+0000) 2021-08-03T12:19:53.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:53.742+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:53.742811+0000) 2021-08-03T12:19:53.843 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:53.840+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:53.841690+0000) 2021-08-03T12:19:54.020 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:54.018+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:54.019751+0000) 2021-08-03T12:19:54.193 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:54.188+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:54.189767+0000) 2021-08-03T12:19:54.615 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:19:54.611+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:54.612757+0000) 2021-08-03T12:19:54.619 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:54.614+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:54.616396+0000) 2021-08-03T12:19:54.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:54.741+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:54.742909+0000) 2021-08-03T12:19:54.844 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:54.841+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:54.842298+0000) 2021-08-03T12:19:55.192 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:55.188+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:55.190399+0000) 2021-08-03T12:19:55.343 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:55.340+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:55.341744+0000) 2021-08-03T12:19:55.845 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:55.842+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:55.843106+0000) 2021-08-03T12:19:55.928 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:19:55.926+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:55.927591+0000) 2021-08-03T12:19:56.192 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:56.189+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:56.190936+0000) 2021-08-03T12:19:56.262 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:19:56.258+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:56.259353+0000) 2021-08-03T12:19:56.344 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:56.340+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:56.342239+0000) 2021-08-03T12:19:56.550 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:56.546+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:56.548006+0000) 2021-08-03T12:19:56.723 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:19:56.721+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:56.722415+0000) 2021-08-03T12:19:56.845 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:56.842+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:56.843740+0000) 2021-08-03T12:19:57.193 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:19:57.189+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:57.191535+0000) 2021-08-03T12:19:57.223 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:57.220+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:57.222395+0000) 2021-08-03T12:19:57.345 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:19:57.341+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:57.342860+0000) 2021-08-03T12:19:57.551 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:19:57.547+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:57.548929+0000) 2021-08-03T12:19:57.563 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:19:57.348+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5483 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:19:57.846 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:57.843+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:57.844396+0000) 2021-08-03T12:19:57.872 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:57.868+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:57.870804+0000) 2021-08-03T12:19:57.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:19:57.958+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:57.960076+0000) 2021-08-03T12:19:58.847 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:58.844+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:58.845539+0000) 2021-08-03T12:19:59.057 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:19:59.028+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2951 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:19:59.365 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:19:59.313+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:19:59.847 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:19:59.845+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:19:59.846391+0000) 2021-08-03T12:20:00.104 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:00.101+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:00.101878+0000) 2021-08-03T12:20:00.288 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:00.285+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:00.287275+0000) 2021-08-03T12:20:00.492 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:00.489+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:00.490290+0000) 2021-08-03T12:20:00.653 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:00.650+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:00.650924+0000) 2021-08-03T12:20:01.492 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:01.490+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:01.491045+0000) 2021-08-03T12:20:02.143 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:02.139+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:02.141057+0000) 2021-08-03T12:20:02.409 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:20:02.406+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:02.407171+0000) 2021-08-03T12:20:02.411 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:02.407+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:02.408948+0000) 2021-08-03T12:20:02.439 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:02.434+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:02.436554+0000) 2021-08-03T12:20:02.512 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:02.508+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:02.509622+0000) 2021-08-03T12:20:02.929 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:20:02.925+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:02.926363+0000) 2021-08-03T12:20:03.516 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:03.512+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:03.514637+0000) 2021-08-03T12:20:03.825 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:03.806+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5490 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:04.824 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:04.821+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:04.823286+0000) 2021-08-03T12:20:04.985 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:04.982+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:04.983038+0000) 2021-08-03T12:20:05.022 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:05.018+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:05.019279+0000) 2021-08-03T12:20:05.304 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:05.301+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:05.302560+0000) 2021-08-03T12:20:05.352 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:05.350+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:05.351483+0000) 2021-08-03T12:20:05.673 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:05.671+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:05.671944+0000) 2021-08-03T12:20:06.305 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:06.302+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:06.303245+0000) 2021-08-03T12:20:06.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:06.673+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:06.674542+0000) 2021-08-03T12:20:06.694 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:06.658+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2951 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:06.698 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:06.694+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:06.695962+0000) 2021-08-03T12:20:07.306 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:07.303+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:07.304081+0000) 2021-08-03T12:20:07.675 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:07.671+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:07.676 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:07.674+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:07.675794+0000) 2021-08-03T12:20:08.323 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:08.319+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:08.320589+0000) 2021-08-03T12:20:08.427 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:08.422+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:08.424002+0000) 2021-08-03T12:20:08.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:08.675+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:08.675947+0000) 2021-08-03T12:20:08.683 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:20:08.679+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:08.681701+0000) 2021-08-03T12:20:09.323 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:09.320+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:09.321525+0000) 2021-08-03T12:20:09.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:09.675+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:09.676085+0000) 2021-08-03T12:20:10.069 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:10.067+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:10.068262+0000) 2021-08-03T12:20:10.128 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:10.124+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:10.125673+0000) 2021-08-03T12:20:10.153 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:10.150+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:10.151089+0000) 2021-08-03T12:20:10.300 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:10.128+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5511 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:10.324 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:10.321+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:10.322413+0000) 2021-08-03T12:20:11.008 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:11.006+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:11.007093+0000) 2021-08-03T12:20:11.569 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:20:11.566+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:11.566771+0000) 2021-08-03T12:20:12.008 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:12.006+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:12.007241+0000) 2021-08-03T12:20:12.145 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:12.141+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:12.142498+0000) 2021-08-03T12:20:12.348 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:12.346+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:12.347792+0000) 2021-08-03T12:20:12.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:12.523+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:12.524249+0000) 2021-08-03T12:20:12.543 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:12.541+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:12.542413+0000) 2021-08-03T12:20:12.736 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:12.733+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:12.733928+0000) 2021-08-03T12:20:12.874 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:12.871+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:12.872138+0000) 2021-08-03T12:20:13.008 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:13.006+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:13.007363+0000) 2021-08-03T12:20:13.257 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:13.253+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:13.254598+0000) 2021-08-03T12:20:13.409 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:13.406+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:13.407246+0000) 2021-08-03T12:20:13.642 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:13.330+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:14.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:14.006+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:14.007517+0000) 2021-08-03T12:20:14.409 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:14.407+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:14.407988+0000) 2021-08-03T12:20:15.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:15.006+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:15.007648+0000) 2021-08-03T12:20:15.060 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:15.058+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:15.058891+0000) 2021-08-03T12:20:15.410 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:15.407+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:15.408583+0000) 2021-08-03T12:20:15.476 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:15.342+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2951 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:15.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:15.742+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:15.743238+0000) 2021-08-03T12:20:16.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:16.006+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:16.007802+0000) 2021-08-03T12:20:16.062 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:16.059+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:16.060111+0000) 2021-08-03T12:20:16.411 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:16.408+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:16.409382+0000) 2021-08-03T12:20:16.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:16.742+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:16.743379+0000) 2021-08-03T12:20:17.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:17.007+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:17.007915+0000) 2021-08-03T12:20:17.063 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:17.060+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:17.061294+0000) 2021-08-03T12:20:17.279 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:17.265+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5513 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:17.411 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:17.409+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:17.409963+0000) 2021-08-03T12:20:17.730 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:17.727+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:17.728228+0000) 2021-08-03T12:20:18.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:18.007+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:18.008049+0000) 2021-08-03T12:20:18.412 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:18.409+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:18.410513+0000) 2021-08-03T12:20:18.731 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:18.728+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:18.729490+0000) 2021-08-03T12:20:19.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:19.007+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:19.008194+0000) 2021-08-03T12:20:19.412 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:19.410+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:19.411107+0000) 2021-08-03T12:20:19.490 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:19.487+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:19.487953+0000) 2021-08-03T12:20:19.561 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:19.559+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:19.560273+0000) 2021-08-03T12:20:20.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:20.007+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:20.008328+0000) 2021-08-03T12:20:20.264 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:20.260+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:20.261740+0000) 2021-08-03T12:20:20.413 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:20.410+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:20.411705+0000) 2021-08-03T12:20:20.615 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:20.447+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:20.885 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:20.883+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:20.884012+0000) 2021-08-03T12:20:21.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:21.007+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:21.008484+0000) 2021-08-03T12:20:21.414 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:21.411+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:21.412556+0000) 2021-08-03T12:20:21.456 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:21.453+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:21.454617+0000) 2021-08-03T12:20:21.576 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:21.381+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2953 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:22.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:22.007+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:22.008637+0000) 2021-08-03T12:20:22.415 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:22.412+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:22.413586+0000) 2021-08-03T12:20:22.457 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:22.454+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:22.455526+0000) 2021-08-03T12:20:22.727 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:22.724+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:22.725101+0000) 2021-08-03T12:20:23.006 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:23.004+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:23.005099+0000) 2021-08-03T12:20:23.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:23.007+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:23.008782+0000) 2021-08-03T12:20:23.415 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:23.413+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:23.414186+0000) 2021-08-03T12:20:23.458 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:23.455+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:23.456485+0000) 2021-08-03T12:20:23.664 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:20:23.661+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:23.661936+0000) 2021-08-03T12:20:24.006 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:24.004+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:24.005247+0000) 2021-08-03T12:20:24.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:24.008+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:24.008960+0000) 2021-08-03T12:20:24.416 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:24.414+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:24.414910+0000) 2021-08-03T12:20:24.459 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:24.456+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:24.457028+0000) 2021-08-03T12:20:24.665 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:20:24.662+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:24.662986+0000) 2021-08-03T12:20:24.701 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:24.642+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5553 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:25.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:25.008+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:25.009095+0000) 2021-08-03T12:20:25.417 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:25.415+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:25.415830+0000) 2021-08-03T12:20:25.459 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:25.456+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:25.457615+0000) 2021-08-03T12:20:25.731 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:25.727+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:25.728219+0000) 2021-08-03T12:20:26.060 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:26.058+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:26.059161+0000) 2021-08-03T12:20:26.418 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:26.415+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:26.416448+0000) 2021-08-03T12:20:26.460 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:26.457+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:26.458207+0000) 2021-08-03T12:20:27.030 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:27.027+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:27.028485+0000) 2021-08-03T12:20:27.080 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:27.022+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6582 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:27.419 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:27.416+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:27.417034+0000) 2021-08-03T12:20:27.461 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:27.458+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:27.458794+0000) 2021-08-03T12:20:27.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:27.872+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:27.873265+0000) 2021-08-03T12:20:28.192 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:28.188+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:28.189594+0000) 2021-08-03T12:20:28.419 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:28.416+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:28.417683+0000) 2021-08-03T12:20:28.461 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:28.458+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:28.459398+0000) 2021-08-03T12:20:29.192 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:29.189+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:29.190534+0000) 2021-08-03T12:20:29.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:29.363+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:29.364452+0000) 2021-08-03T12:20:29.373 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:29.371+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:29.372312+0000) 2021-08-03T12:20:29.461 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:29.459+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:29.459901+0000) 2021-08-03T12:20:30.009 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:20:30.005+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:30.006315+0000) 2021-08-03T12:20:30.076 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:30.072+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:30.073733+0000) 2021-08-03T12:20:30.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:30.085+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:30.086441+0000) 2021-08-03T12:20:30.193 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:30.190+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:30.191332+0000) 2021-08-03T12:20:30.399 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:30.379+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5564 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:30.462 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:30.459+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:30.460451+0000) 2021-08-03T12:20:30.559 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:30.403+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2966 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:30.591 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:30.588+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:30.588914+0000) 2021-08-03T12:20:31.194 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:31.191+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:31.191922+0000) 2021-08-03T12:20:31.463 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:31.460+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:31.460991+0000) 2021-08-03T12:20:32.106 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:32.102+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:32.103491+0000) 2021-08-03T12:20:32.176 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:32.174+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:32.175825+0000) 2021-08-03T12:20:32.195 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:32.191+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:32.192529+0000) 2021-08-03T12:20:32.337 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:32.333+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:32.334397+0000) 2021-08-03T12:20:32.463 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:32.460+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:32.461673+0000) 2021-08-03T12:20:32.601 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:20:32.598+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:32.599043+0000) 2021-08-03T12:20:33.196 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:33.192+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:33.193338+0000) 2021-08-03T12:20:33.464 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:33.461+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:33.462046+0000) 2021-08-03T12:20:33.921 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:33.919+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:33.920119+0000) 2021-08-03T12:20:34.195 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:34.193+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:34.193933+0000) 2021-08-03T12:20:34.464 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:34.461+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:34.462639+0000) 2021-08-03T12:20:34.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:34.754+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:34.755435+0000) 2021-08-03T12:20:35.196 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:35.193+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:35.194498+0000) 2021-08-03T12:20:35.317 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:35.037+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6585 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:35.465 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:35.462+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:35.463235+0000) 2021-08-03T12:20:35.670 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:35.535+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2975 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:35.844 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:35.840+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:35.841703+0000) 2021-08-03T12:20:36.173 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:36.170+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:36.171619+0000) 2021-08-03T12:20:36.198 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:36.194+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:36.195692+0000) 2021-08-03T12:20:36.466 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:36.463+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:36.463837+0000) 2021-08-03T12:20:36.498 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:36.365+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5587 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:37.174 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:37.171+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:37.172335+0000) 2021-08-03T12:20:37.199 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:37.195+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:37.196398+0000) 2021-08-03T12:20:37.466 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:37.463+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:37.464506+0000) 2021-08-03T12:20:38.038 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:38.035+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:38.036804+0000) 2021-08-03T12:20:38.175 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:38.172+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:38.173165+0000) 2021-08-03T12:20:38.199 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:38.196+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:38.197227+0000) 2021-08-03T12:20:38.471 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:38.464+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:38.465384+0000) 2021-08-03T12:20:39.176 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:39.173+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.173983+0000) 2021-08-03T12:20:39.200 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:39.197+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.197916+0000) 2021-08-03T12:20:39.252 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:39.249+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.249953+0000) 2021-08-03T12:20:39.344 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:39.342+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.342882+0000) 2021-08-03T12:20:39.468 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:39.465+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.465944+0000) 2021-08-03T12:20:39.716 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:39.714+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.715279+0000) 2021-08-03T12:20:39.735 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:20:39.731+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.732501+0000) 2021-08-03T12:20:39.737 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:39.734+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:39.734962+0000) 2021-08-03T12:20:40.177 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:40.173+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:40.174562+0000) 2021-08-03T12:20:40.200 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:40.196+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:40.198622+0000) 2021-08-03T12:20:40.344 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:40.341+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:40.343041+0000) 2021-08-03T12:20:40.468 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:40.464+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:40.466547+0000) 2021-08-03T12:20:40.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:40.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:40.588082+0000) 2021-08-03T12:20:40.681 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:40.674+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:40.676528+0000) 2021-08-03T12:20:40.738 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:40.735+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:40.736047+0000) 2021-08-03T12:20:41.179 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:41.176+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.176795+0000) 2021-08-03T12:20:41.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:41.197+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.199034+0000) 2021-08-03T12:20:41.201 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:41.197+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.199160+0000) 2021-08-03T12:20:41.344 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:41.341+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.343195+0000) 2021-08-03T12:20:41.469 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:41.465+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.467186+0000) 2021-08-03T12:20:41.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:41.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.588211+0000) 2021-08-03T12:20:41.684 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:41.678+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.679952+0000) 2021-08-03T12:20:41.739 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:41.736+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:41.736926+0000) 2021-08-03T12:20:41.839 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:41.714+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6586 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:42.180 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:42.177+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.178209+0000) 2021-08-03T12:20:42.201 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:42.197+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.199710+0000) 2021-08-03T12:20:42.344 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:42.341+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.343344+0000) 2021-08-03T12:20:42.380 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:20:42.375+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.377412+0000) 2021-08-03T12:20:42.469 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:42.466+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.467857+0000) 2021-08-03T12:20:42.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:42.586+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.588352+0000) 2021-08-03T12:20:42.683 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:42.679+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.681722+0000) 2021-08-03T12:20:42.739 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:42.736+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:42.737510+0000) 2021-08-03T12:20:42.878 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:42.768+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2979 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:43.182 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:43.178+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:43.179389+0000) 2021-08-03T12:20:43.204 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:43.198+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:43.200606+0000) 2021-08-03T12:20:43.344 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:43.341+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:43.343476+0000) 2021-08-03T12:20:43.470 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:43.466+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:43.468417+0000) 2021-08-03T12:20:43.683 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:43.680+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:43.681854+0000) 2021-08-03T12:20:43.740 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:43.737+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:43.738103+0000) 2021-08-03T12:20:44.020 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:44.016+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:44.018358+0000) 2021-08-03T12:20:44.183 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:43.823+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5603 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:44.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:44.341+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:44.343636+0000) 2021-08-03T12:20:44.471 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:44.467+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:44.468977+0000) 2021-08-03T12:20:44.585 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:44.583+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:44.584447+0000) 2021-08-03T12:20:44.683 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:44.680+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:44.682055+0000) 2021-08-03T12:20:44.740 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:44.737+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:44.738706+0000) 2021-08-03T12:20:45.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:45.341+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:45.343806+0000) 2021-08-03T12:20:45.471 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:45.467+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:45.469547+0000) 2021-08-03T12:20:45.741 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:45.738+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:45.739253+0000) 2021-08-03T12:20:46.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:46.342+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:46.343950+0000) 2021-08-03T12:20:46.472 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:46.468+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:46.470144+0000) 2021-08-03T12:20:46.694 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:46.691+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:46.691951+0000) 2021-08-03T12:20:46.742 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:46.739+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:46.739858+0000) 2021-08-03T12:20:47.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:47.342+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:47.344101+0000) 2021-08-03T12:20:47.472 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:47.468+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:47.470675+0000) 2021-08-03T12:20:47.742 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:47.739+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:47.740502+0000) 2021-08-03T12:20:48.003 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:47.999+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:48.000307+0000) 2021-08-03T12:20:48.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:48.342+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:48.344261+0000) 2021-08-03T12:20:48.473 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:48.469+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:48.471566+0000) 2021-08-03T12:20:48.591 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:48.538+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:48.540652+0000) 2021-08-03T12:20:48.742 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:48.740+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:48.741108+0000) 2021-08-03T12:20:48.911 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:20:48.907+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:48.908555+0000) 2021-08-03T12:20:49.018 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:48.983+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6586 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:49.283 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:49.279+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:49.280716+0000) 2021-08-03T12:20:49.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:49.285+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:49.286593+0000) 2021-08-03T12:20:49.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:49.343+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:49.344413+0000) 2021-08-03T12:20:49.474 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:49.471+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:49.472123+0000) 2021-08-03T12:20:49.663 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:49.645+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2979 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:49.743 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:49.740+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:49.741685+0000) 2021-08-03T12:20:50.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:50.343+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:50.344535+0000) 2021-08-03T12:20:50.446 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:50.441+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:50.442532+0000) 2021-08-03T12:20:50.474 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:50.471+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:50.472673+0000) 2021-08-03T12:20:50.744 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:50.741+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:50.742392+0000) 2021-08-03T12:20:50.936 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:50.933+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:50.934312+0000) 2021-08-03T12:20:50.956 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:50.953+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:50.953887+0000) 2021-08-03T12:20:51.133 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:50.957+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5631 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:51.346 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:51.343+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:51.344691+0000) 2021-08-03T12:20:51.475 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:51.472+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:51.473216+0000) 2021-08-03T12:20:51.745 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:51.742+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:51.742990+0000) 2021-08-03T12:20:51.957 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:51.953+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:51.954562+0000) 2021-08-03T12:20:52.346 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:52.344+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:52.344865+0000) 2021-08-03T12:20:52.475 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:52.473+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:52.473875+0000) 2021-08-03T12:20:52.745 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:52.742+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:52.743574+0000) 2021-08-03T12:20:52.952 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:20:52.949+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:52.949881+0000) 2021-08-03T12:20:52.956 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:52.954+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:52.955172+0000) 2021-08-03T12:20:53.462 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:53.458+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:53.458826+0000) 2021-08-03T12:20:53.476 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:53.473+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:53.474438+0000) 2021-08-03T12:20:53.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:53.629+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:53.630612+0000) 2021-08-03T12:20:53.747 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:53.743+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:53.744206+0000) 2021-08-03T12:20:53.958 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:53.955+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:53.955740+0000) 2021-08-03T12:20:54.305 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:20:54.300+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:54.301190+0000) 2021-08-03T12:20:54.747 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:54.744+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:54.744801+0000) 2021-08-03T12:20:54.958 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:54.955+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:54.956328+0000) 2021-08-03T12:20:55.030 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:20:55.026+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:55.027660+0000) 2021-08-03T12:20:55.252 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:20:55.216+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6586 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:20:55.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:55.256+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:55.257377+0000) 2021-08-03T12:20:55.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:55.484+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:55.485498+0000) 2021-08-03T12:20:55.747 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:55.744+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:55.745612+0000) 2021-08-03T12:20:55.959 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:55.956+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:55.957155+0000) 2021-08-03T12:20:56.242 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:56.239+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:56.240323+0000) 2021-08-03T12:20:56.568 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:20:56.209+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2979 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:20:56.748 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:56.745+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:56.746445+0000) 2021-08-03T12:20:56.959 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:56.956+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:56.957719+0000) 2021-08-03T12:20:57.243 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:57.240+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:57.240999+0000) 2021-08-03T12:20:57.749 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:57.746+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:57.747059+0000) 2021-08-03T12:20:57.843 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:20:57.838+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:57.839492+0000) 2021-08-03T12:20:57.961 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:20:57.957+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:57.958346+0000) 2021-08-03T12:20:58.064 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:20:58.045+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5652 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:20:58.575 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:20:58.572+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:58.574059+0000) 2021-08-03T12:20:58.749 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:58.745+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:58.747662+0000) 2021-08-03T12:20:58.811 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:20:58.803+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:58.805148+0000) 2021-08-03T12:20:59.652 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:20:59.650+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:59.650871+0000) 2021-08-03T12:20:59.750 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:20:59.746+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:20:59.748293+0000) 2021-08-03T12:21:00.751 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:00.747+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:00.749011+0000) 2021-08-03T12:21:01.230 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:01.226+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:01.227726+0000) 2021-08-03T12:21:01.736 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:01.733+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:01.734168+0000) 2021-08-03T12:21:01.751 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:01.748+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:01.749857+0000) 2021-08-03T12:21:02.149 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:02.145+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:02.146346+0000) 2021-08-03T12:21:02.230 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:02.227+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:02.228354+0000) 2021-08-03T12:21:02.608 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:02.332+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6586 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:02.752 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:02.749+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:02.751156+0000) 2021-08-03T12:21:03.231 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:03.228+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:03.229313+0000) 2021-08-03T12:21:03.642 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:03.639+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:03.640485+0000) 2021-08-03T12:21:03.753 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:03.750+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:03.752084+0000) 2021-08-03T12:21:03.776 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:03.771+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:03.773478+0000) 2021-08-03T12:21:04.232 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:04.229+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:04.229916+0000) 2021-08-03T12:21:04.488 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:04.417+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2987 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:04.643 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:04.640+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:04.641179+0000) 2021-08-03T12:21:04.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:04.656+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:04.657802+0000) 2021-08-03T12:21:04.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:04.657+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:04.658453+0000) 2021-08-03T12:21:04.754 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:04.751+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:04.752653+0000) 2021-08-03T12:21:05.701 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:05.698+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:05.698888+0000) 2021-08-03T12:21:05.714 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:05.711+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:05.711738+0000) 2021-08-03T12:21:05.755 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:05.752+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:05.753259+0000) 2021-08-03T12:21:05.882 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:05.692+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5664 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:06.756 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:06.753+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:06.754050+0000) 2021-08-03T12:21:07.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:07.212+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:07.212969+0000) 2021-08-03T12:21:07.264 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:21:07.259+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:07.260558+0000) 2021-08-03T12:21:07.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:07.743+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:07.744045+0000) 2021-08-03T12:21:07.756 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:07.753+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:07.754643+0000) 2021-08-03T12:21:08.309 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:08.306+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6586 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:08.570 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:08.567+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:08.567987+0000) 2021-08-03T12:21:08.582 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:08.580+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:08.581585+0000) 2021-08-03T12:21:08.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:08.743+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:08.744167+0000) 2021-08-03T12:21:08.757 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:08.754+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:08.755461+0000) 2021-08-03T12:21:08.824 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:08.821+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:08.822682+0000) 2021-08-03T12:21:09.135 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:09.129+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:09.129963+0000) 2021-08-03T12:21:09.467 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:09.465+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:09.466570+0000) 2021-08-03T12:21:09.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:09.743+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:09.744325+0000) 2021-08-03T12:21:09.759 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:09.755+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:09.756730+0000) 2021-08-03T12:21:09.826 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:09.823+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:09.824052+0000) 2021-08-03T12:21:09.899 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:09.896+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:09.897168+0000) 2021-08-03T12:21:10.287 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:10.283+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:10.284355+0000) 2021-08-03T12:21:10.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:10.743+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:10.744448+0000) 2021-08-03T12:21:10.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:10.783+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:10.784679+0000) 2021-08-03T12:21:10.830 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:10.826+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:10.827771+0000) 2021-08-03T12:21:10.845 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:10.810+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2990 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:11.032 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:11.028+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:11.029205+0000) 2021-08-03T12:21:11.068 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:11.032+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5680 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:12.208 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:12.206+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:12.207577+0000) 2021-08-03T12:21:13.468 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:13.465+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:13.466648+0000) 2021-08-03T12:21:13.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:13.587+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:13.588759+0000) 2021-08-03T12:21:14.469 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:14.466+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:14.467288+0000) 2021-08-03T12:21:14.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:14.588+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:14.588876+0000) 2021-08-03T12:21:14.919 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:14.916+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:14.917687+0000) 2021-08-03T12:21:15.471 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:15.467+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:15.468552+0000) 2021-08-03T12:21:15.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:15.566+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:15.567579+0000) 2021-08-03T12:21:15.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:15.588+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:15.588973+0000) 2021-08-03T12:21:15.684 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:15.681+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:15.682502+0000) 2021-08-03T12:21:15.833 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:15.829+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:15.830205+0000) 2021-08-03T12:21:15.838 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:15.835+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:15.835988+0000) 2021-08-03T12:21:16.288 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:16.285+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6586 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:16.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:16.566+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:16.567747+0000) 2021-08-03T12:21:16.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:16.588+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:16.589090+0000) 2021-08-03T12:21:16.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:16.685+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:16.686282+0000) 2021-08-03T12:21:16.787 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:16.783+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:16.784536+0000) 2021-08-03T12:21:17.213 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:17.209+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:17.210298+0000) 2021-08-03T12:21:17.247 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:17.244+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:17.245154+0000) 2021-08-03T12:21:17.446 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:17.439+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5684 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:17.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:17.567+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:17.567897+0000) 2021-08-03T12:21:17.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:17.588+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:17.589206+0000) 2021-08-03T12:21:17.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:17.686+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:17.687509+0000) 2021-08-03T12:21:18.136 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:18.132+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:18.133192+0000) 2021-08-03T12:21:18.603 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:18.601+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:18.602007+0000) 2021-08-03T12:21:18.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:18.686+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:18.687701+0000) 2021-08-03T12:21:18.910 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:18.633+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2996 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:19.158 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:19.154+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:19.155686+0000) 2021-08-03T12:21:19.291 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:21:19.286+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:19.286960+0000) 2021-08-03T12:21:19.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:19.687+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:19.687862+0000) 2021-08-03T12:21:19.927 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:19.924+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:19.925014+0000) 2021-08-03T12:21:20.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:20.687+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:20.688046+0000) 2021-08-03T12:21:20.940 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:20.936+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:20.937467+0000) 2021-08-03T12:21:21.448 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:21.445+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:21.446315+0000) 2021-08-03T12:21:21.533 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:21.531+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:21.532446+0000) 2021-08-03T12:21:21.537 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:21.535+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:21.536641+0000) 2021-08-03T12:21:21.690 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:21.687+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:21.688153+0000) 2021-08-03T12:21:21.907 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:21.904+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:21.904961+0000) 2021-08-03T12:21:21.960 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:21.957+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:21.958217+0000) 2021-08-03T12:21:22.457 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:22.446+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:22.447192+0000) 2021-08-03T12:21:22.961 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:22.957+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:22.958771+0000) 2021-08-03T12:21:23.320 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:23.317+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:23.318646+0000) 2021-08-03T12:21:23.450 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:23.447+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:23.447750+0000) 2021-08-03T12:21:24.050 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:23.714+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5712 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:24.154 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:24.104+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6586 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:24.351 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:23.923+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2996 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:25.007 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:25.005+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:25.006207+0000) 2021-08-03T12:21:25.286 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:25.282+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:25.283004+0000) 2021-08-03T12:21:26.007 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:26.005+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:26.006343+0000) 2021-08-03T12:21:27.074 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:27.069+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:27.069895+0000) 2021-08-03T12:21:27.533 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:27.530+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:27.532065+0000) 2021-08-03T12:21:27.595 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:27.592+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:27.594275+0000) 2021-08-03T12:21:27.803 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:27.800+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:27.801199+0000) 2021-08-03T12:21:28.246 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:28.244+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:28.244779+0000) 2021-08-03T12:21:28.428 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:28.424+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:28.425726+0000) 2021-08-03T12:21:29.247 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:29.244+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:29.245691+0000) 2021-08-03T12:21:29.428 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:29.424+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:29.426415+0000) 2021-08-03T12:21:29.505 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:29.501+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:29.503447+0000) 2021-08-03T12:21:29.601 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:29.598+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2999 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:29.612 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:29.570+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5727 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:29.617 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:29.613+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:29.614491+0000) 2021-08-03T12:21:29.688 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:29.683+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:29.685421+0000) 2021-08-03T12:21:29.953 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:29.950+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:29.952396+0000) 2021-08-03T12:21:30.250 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:30.247+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:30.248384+0000) 2021-08-03T12:21:30.321 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:30.316+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:30.318179+0000) 2021-08-03T12:21:30.515 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:30.278+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6589 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:31.251 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:31.248+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:31.249748+0000) 2021-08-03T12:21:31.550 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:31.548+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:31.549711+0000) 2021-08-03T12:21:31.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:31.587+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:31.589551+0000) 2021-08-03T12:21:31.903 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:31.899+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:31.901599+0000) 2021-08-03T12:21:32.252 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:32.249+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:32.250336+0000) 2021-08-03T12:21:33.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:33.129+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:33.131770+0000) 2021-08-03T12:21:35.073 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:35.071+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:35.072188+0000) 2021-08-03T12:21:35.488 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:35.485+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:35.485825+0000) 2021-08-03T12:21:35.542 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:35.498+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5740 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:36.129 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:36.125+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:36.126741+0000) 2021-08-03T12:21:36.135 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:36.131+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:36.132106+0000) 2021-08-03T12:21:36.201 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:21:36.197+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:36.198499+0000) 2021-08-03T12:21:36.853 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:36.796+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6589 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:36.854 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:36.849+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:36.850529+0000) 2021-08-03T12:21:36.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:36.864+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:36.865662+0000) 2021-08-03T12:21:37.103 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:36.802+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2999 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:37.466 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:37.462+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:37.463631+0000) 2021-08-03T12:21:37.925 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:37.921+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:37.922598+0000) 2021-08-03T12:21:37.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:37.968+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:37.968856+0000) 2021-08-03T12:21:38.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:38.721+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:38.722448+0000) 2021-08-03T12:21:38.925 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:38.922+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:38.923602+0000) 2021-08-03T12:21:39.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:39.762+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:39.762971+0000) 2021-08-03T12:21:39.926 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:39.923+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:39.924182+0000) 2021-08-03T12:21:40.064 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:40.061+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:40.062103+0000) 2021-08-03T12:21:40.271 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:40.267+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:40.268269+0000) 2021-08-03T12:21:40.927 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:40.924+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:40.924754+0000) 2021-08-03T12:21:41.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:41.743+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:41.744781+0000) 2021-08-03T12:21:41.790 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:41.787+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:41.788123+0000) 2021-08-03T12:21:41.927 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:41.924+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:41.925557+0000) 2021-08-03T12:21:42.029 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:41.977+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2999 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:42.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:42.744+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:42.744936+0000) 2021-08-03T12:21:42.791 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:42.788+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:42.788856+0000) 2021-08-03T12:21:42.928 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:42.925+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:42.926564+0000) 2021-08-03T12:21:43.083 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:42.973+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5748 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:43.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:43.325+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:43.326232+0000) 2021-08-03T12:21:43.644 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:43.640+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:43.641100+0000) 2021-08-03T12:21:43.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:43.718+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:43.719285+0000) 2021-08-03T12:21:43.791 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:43.788+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:43.789462+0000) 2021-08-03T12:21:44.031 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:43.994+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6593 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:44.125 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:44.120+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:44.121218+0000) 2021-08-03T12:21:44.607 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:44.603+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:44.604680+0000) 2021-08-03T12:21:44.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:44.754+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:44.754870+0000) 2021-08-03T12:21:44.758 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:44.756+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:44.757737+0000) 2021-08-03T12:21:46.236 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:46.234+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:46.235330+0000) 2021-08-03T12:21:46.665 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:46.663+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:46.664428+0000) 2021-08-03T12:21:47.236 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:47.234+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:47.235476+0000) 2021-08-03T12:21:47.627 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:47.623+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:47.624424+0000) 2021-08-03T12:21:47.997 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:47.993+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:47.994690+0000) 2021-08-03T12:21:48.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:48.234+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:48.235612+0000) 2021-08-03T12:21:48.554 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:21:48.550+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:48.551365+0000) 2021-08-03T12:21:48.571 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:48.567+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:48.568194+0000) 2021-08-03T12:21:48.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:48.588+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:48.589560+0000) 2021-08-03T12:21:48.659 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:48.635+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5755 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:49.102 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:49.100+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:49.101383+0000) 2021-08-03T12:21:49.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:49.234+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:49.235740+0000) 2021-08-03T12:21:49.283 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:49.280+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:49.281081+0000) 2021-08-03T12:21:49.391 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:21:49.388+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:49.389034+0000) 2021-08-03T12:21:49.591 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:49.588+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:49.589711+0000) 2021-08-03T12:21:49.831 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:49.257+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6593 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:49.951 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:49.883+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 2999 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:50.094 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:50.091+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:50.091894+0000) 2021-08-03T12:21:50.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:50.235+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:50.235856+0000) 2021-08-03T12:21:50.284 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:50.281+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:50.282130+0000) 2021-08-03T12:21:50.591 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:50.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:50.589857+0000) 2021-08-03T12:21:51.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:51.235+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:51.235981+0000) 2021-08-03T12:21:51.591 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:51.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:51.589996+0000) 2021-08-03T12:21:52.047 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:21:52.042+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:52.043464+0000) 2021-08-03T12:21:52.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:52.235+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:52.236112+0000) 2021-08-03T12:21:52.309 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:52.307+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:52.307961+0000) 2021-08-03T12:21:52.335 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:21:52.332+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:52.333068+0000) 2021-08-03T12:21:52.366 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:21:52.362+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:52.362897+0000) 2021-08-03T12:21:52.591 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:52.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:52.590099+0000) 2021-08-03T12:21:53.191 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:53.187+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:53.188002+0000) 2021-08-03T12:21:53.213 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:53.210+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:53.211591+0000) 2021-08-03T12:21:53.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:53.235+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:53.236242+0000) 2021-08-03T12:21:53.591 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:53.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:53.590271+0000) 2021-08-03T12:21:54.214 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:54.211+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:54.212291+0000) 2021-08-03T12:21:54.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:54.235+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:54.236376+0000) 2021-08-03T12:21:54.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:54.408+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:54.409551+0000) 2021-08-03T12:21:54.471 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:54.469+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:54.470691+0000) 2021-08-03T12:21:54.929 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:21:54.925+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:54.925969+0000) 2021-08-03T12:21:55.131 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:21:54.993+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6593 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:21:55.238 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:55.235+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:55.236500+0000) 2021-08-03T12:21:55.448 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:21:55.246+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5779 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:21:55.504 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:55.500+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:55.501339+0000) 2021-08-03T12:21:55.793 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:21:55.791+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:55.792080+0000) 2021-08-03T12:21:56.160 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:21:56.038+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3000 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:21:56.329 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:21:56.325+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:56.326259+0000) 2021-08-03T12:21:57.008 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:57.004+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:57.006700+0000) 2021-08-03T12:21:57.840 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:57.835+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:57.836526+0000) 2021-08-03T12:21:58.008 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:58.004+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:58.006856+0000) 2021-08-03T12:21:58.786 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:21:58.782+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:58.783563+0000) 2021-08-03T12:21:58.935 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:21:58.930+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:58.932504+0000) 2021-08-03T12:21:59.008 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:21:59.005+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:59.007001+0000) 2021-08-03T12:21:59.984 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:21:59.981+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:21:59.981947+0000) 2021-08-03T12:22:00.008 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:00.005+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:00.007133+0000) 2021-08-03T12:22:00.055 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:00.053+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:00.053828+0000) 2021-08-03T12:22:00.115 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:00.111+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:00.112982+0000) 2021-08-03T12:22:00.166 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:00.161+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:00.162904+0000) 2021-08-03T12:22:00.872 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:00.862+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:00.864159+0000) 2021-08-03T12:22:00.984 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:00.981+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:00.982617+0000) 2021-08-03T12:22:01.065 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:01.061+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:01.062005+0000) 2021-08-03T12:22:01.286 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:01.171+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6593 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:01.985 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:01.982+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:01.983385+0000) 2021-08-03T12:22:02.659 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:02.656+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:02.658035+0000) 2021-08-03T12:22:02.986 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:02.983+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:02.984085+0000) 2021-08-03T12:22:03.257 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:03.252+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:03.254700+0000) 2021-08-03T12:22:03.617 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:03.425+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5812 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:03.758 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:03.410+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3002 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:03.986 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:03.983+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:03.984645+0000) 2021-08-03T12:22:04.024 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:04.020+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:04.021475+0000) 2021-08-03T12:22:04.257 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:04.254+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:04.255742+0000) 2021-08-03T12:22:04.653 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:04.649+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:04.650295+0000) 2021-08-03T12:22:04.907 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:04.904+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:04.905608+0000) 2021-08-03T12:22:04.987 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:04.984+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:04.985375+0000) 2021-08-03T12:22:05.258 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:05.255+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:05.256773+0000) 2021-08-03T12:22:05.512 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:05.510+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:05.511438+0000) 2021-08-03T12:22:05.661 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:05.657+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:05.658595+0000) 2021-08-03T12:22:06.260 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:06.256+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:06.257368+0000) 2021-08-03T12:22:06.317 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:06.313+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:06.314160+0000) 2021-08-03T12:22:06.431 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:06.427+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:06.428079+0000) 2021-08-03T12:22:06.475 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:06.472+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:06.473582+0000) 2021-08-03T12:22:06.990 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:06.986+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:06.986971+0000) 2021-08-03T12:22:06.993 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:06.991+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:06.991832+0000) 2021-08-03T12:22:07.262 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:07.258+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:07.259664+0000) 2021-08-03T12:22:07.476 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:07.473+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:07.474256+0000) 2021-08-03T12:22:07.584 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:07.580+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6599 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:07.915 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:07.912+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:07.913592+0000) 2021-08-03T12:22:08.172 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:08.169+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:08.169832+0000) 2021-08-03T12:22:08.262 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:08.259+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:08.260458+0000) 2021-08-03T12:22:08.477 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:08.474+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:08.475062+0000) 2021-08-03T12:22:08.486 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:08.481+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:08.482422+0000) 2021-08-03T12:22:09.118 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:09.095+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5822 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:09.263 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:09.260+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:09.261010+0000) 2021-08-03T12:22:09.477 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:09.474+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:09.475635+0000) 2021-08-03T12:22:09.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:09.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:09.570337+0000) 2021-08-03T12:22:10.063 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:10.060+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:10.061711+0000) 2021-08-03T12:22:10.263 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:10.260+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:10.261609+0000) 2021-08-03T12:22:10.478 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:10.475+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:10.476211+0000) 2021-08-03T12:22:10.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:10.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:10.570485+0000) 2021-08-03T12:22:10.599 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:10.596+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:10.597747+0000) 2021-08-03T12:22:11.264 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:11.261+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:11.262419+0000) 2021-08-03T12:22:11.479 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:11.476+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:11.477125+0000) 2021-08-03T12:22:11.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:11.568+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:11.570644+0000) 2021-08-03T12:22:12.113 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:12.109+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:12.111576+0000) 2021-08-03T12:22:12.265 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:12.262+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:12.263001+0000) 2021-08-03T12:22:12.422 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:12.417+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:12.419179+0000) 2021-08-03T12:22:12.480 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:12.477+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:12.477955+0000) 2021-08-03T12:22:12.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:12.568+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:12.570802+0000) 2021-08-03T12:22:12.886 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:12.882+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:12.884694+0000) 2021-08-03T12:22:12.899 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:12.895+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:12.897142+0000) 2021-08-03T12:22:13.052 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:13.047+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:13.049597+0000) 2021-08-03T12:22:13.266 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:13.262+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:13.263599+0000) 2021-08-03T12:22:13.480 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:13.477+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:13.478518+0000) 2021-08-03T12:22:13.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:13.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:13.570949+0000) 2021-08-03T12:22:13.747 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:13.743+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:13.745307+0000) 2021-08-03T12:22:13.968 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:13.116+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3017 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:14.153 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:14.147+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:14.149619+0000) 2021-08-03T12:22:14.481 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:14.478+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:14.479100+0000) 2021-08-03T12:22:14.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:14.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:14.571077+0000) 2021-08-03T12:22:14.734 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:14.501+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6613 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:14.852 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:14.738+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5828 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:15.388 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:15.384+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:15.385728+0000) 2021-08-03T12:22:15.482 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:15.479+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:15.479933+0000) 2021-08-03T12:22:15.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:15.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:15.571254+0000) 2021-08-03T12:22:16.388 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:16.385+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:16.387190+0000) 2021-08-03T12:22:16.413 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:16.409+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:16.410042+0000) 2021-08-03T12:22:16.483 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:16.479+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:16.480353+0000) 2021-08-03T12:22:16.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:16.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:16.571365+0000) 2021-08-03T12:22:17.161 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:17.158+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:17.159996+0000) 2021-08-03T12:22:17.273 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:17.270+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:17.270969+0000) 2021-08-03T12:22:17.484 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:17.481+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:17.482456+0000) 2021-08-03T12:22:17.521 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:17.519+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:17.520321+0000) 2021-08-03T12:22:17.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:17.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:17.571512+0000) 2021-08-03T12:22:17.806 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:17.801+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:17.802820+0000) 2021-08-03T12:22:17.999 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:17.995+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:17.997028+0000) 2021-08-03T12:22:18.085 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:18.081+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:18.082604+0000) 2021-08-03T12:22:18.274 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:18.270+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:18.271708+0000) 2021-08-03T12:22:18.486 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:18.483+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:18.483895+0000) 2021-08-03T12:22:18.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:18.569+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:18.571651+0000) 2021-08-03T12:22:18.999 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:18.995+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:18.997711+0000) 2021-08-03T12:22:19.275 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:19.271+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:19.272553+0000) 2021-08-03T12:22:19.486 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:19.483+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:19.484666+0000) 2021-08-03T12:22:19.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:19.570+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:19.571802+0000) 2021-08-03T12:22:20.000 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:19.997+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:19.998263+0000) 2021-08-03T12:22:20.001 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:19.778+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:20.117 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:20.115+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:20.116317+0000) 2021-08-03T12:22:20.169 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:20.167+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:20.168088+0000) 2021-08-03T12:22:20.275 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:20.272+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:20.273384+0000) 2021-08-03T12:22:20.487 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:20.484+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:20.485242+0000) 2021-08-03T12:22:20.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:20.571+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:20.571972+0000) 2021-08-03T12:22:21.001 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:20.998+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:20.998871+0000) 2021-08-03T12:22:21.179 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:21.175+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:21.176208+0000) 2021-08-03T12:22:21.276 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:21.273+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:21.273968+0000) 2021-08-03T12:22:21.419 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:21.106+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3033 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:21.488 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:21.485+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:21.485838+0000) 2021-08-03T12:22:21.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:21.571+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:21.572090+0000) 2021-08-03T12:22:21.733 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:21.671+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5837 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:22.179 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:22.176+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:22.177170+0000) 2021-08-03T12:22:22.276 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:22.274+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:22.274842+0000) 2021-08-03T12:22:22.488 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:22.485+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:22.486636+0000) 2021-08-03T12:22:22.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:22.571+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:22.572255+0000) 2021-08-03T12:22:22.690 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:22.688+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:22.689050+0000) 2021-08-03T12:22:23.050 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:23.046+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.046688+0000) 2021-08-03T12:22:23.180 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:23.177+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.177750+0000) 2021-08-03T12:22:23.213 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:23.209+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.210277+0000) 2021-08-03T12:22:23.234 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:23.231+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.231930+0000) 2021-08-03T12:22:23.277 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:23.274+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.275452+0000) 2021-08-03T12:22:23.489 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:23.486+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.487243+0000) 2021-08-03T12:22:23.540 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:23.536+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.537267+0000) 2021-08-03T12:22:23.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:23.571+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.572394+0000) 2021-08-03T12:22:23.693 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:23.690+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:23.691586+0000) 2021-08-03T12:22:24.181 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:24.177+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:24.178542+0000) 2021-08-03T12:22:24.278 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:24.275+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:24.276237+0000) 2021-08-03T12:22:24.457 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:24.453+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:24.454699+0000) 2021-08-03T12:22:24.492 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:24.487+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:24.487997+0000) 2021-08-03T12:22:24.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:24.571+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:24.572541+0000) 2021-08-03T12:22:24.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:24.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:24.590623+0000) 2021-08-03T12:22:24.694 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:24.692+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:24.692903+0000) 2021-08-03T12:22:25.181 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:25.178+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:25.179271+0000) 2021-08-03T12:22:25.279 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:25.276+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:25.276812+0000) 2021-08-03T12:22:25.457 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:25.454+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:25.455438+0000) 2021-08-03T12:22:25.490 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:25.487+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:25.488581+0000) 2021-08-03T12:22:25.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:25.571+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:25.572694+0000) 2021-08-03T12:22:25.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:25.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:25.590745+0000) 2021-08-03T12:22:25.694 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:25.692+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:25.693037+0000) 2021-08-03T12:22:26.182 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:26.179+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:26.180020+0000) 2021-08-03T12:22:26.279 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:26.276+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:26.277366+0000) 2021-08-03T12:22:26.422 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:26.342+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6644 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:26.458 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:26.455+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:26.456079+0000) 2021-08-03T12:22:26.492 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:26.488+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:26.489403+0000) 2021-08-03T12:22:26.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:26.572+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:26.572846+0000) 2021-08-03T12:22:26.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:26.590+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:26.590849+0000) 2021-08-03T12:22:26.694 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:26.692+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:26.693204+0000) 2021-08-03T12:22:26.895 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:26.887+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3036 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:27.024 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:27.021+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:27.022875+0000) 2021-08-03T12:22:27.182 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:27.179+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:27.180565+0000) 2021-08-03T12:22:27.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:27.277+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:27.277905+0000) 2021-08-03T12:22:27.492 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:27.489+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:27.490147+0000) 2021-08-03T12:22:27.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:27.571+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:27.572694+0000) 2021-08-03T12:22:27.694 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:27.692+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:27.693338+0000) 2021-08-03T12:22:27.738 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:27.551+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5850 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:28.183 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:28.180+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:28.181125+0000) 2021-08-03T12:22:28.493 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:28.490+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:28.491115+0000) 2021-08-03T12:22:28.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:28.692+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:28.693535+0000) 2021-08-03T12:22:28.724 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:28.721+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:28.722147+0000) 2021-08-03T12:22:29.120 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:29.117+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:29.118132+0000) 2021-08-03T12:22:29.184 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:29.180+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:29.181713+0000) 2021-08-03T12:22:29.493 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:29.490+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:29.491692+0000) 2021-08-03T12:22:29.600 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:29.598+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:29.598978+0000) 2021-08-03T12:22:29.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:29.692+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:29.693693+0000) 2021-08-03T12:22:30.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:30.008+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:30.008840+0000) 2021-08-03T12:22:30.094 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:30.091+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:30.091941+0000) 2021-08-03T12:22:30.184 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:30.181+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:30.182464+0000) 2021-08-03T12:22:30.494 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:30.491+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:30.492288+0000) 2021-08-03T12:22:30.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:30.693+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:30.693875+0000) 2021-08-03T12:22:31.095 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:31.092+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:31.092890+0000) 2021-08-03T12:22:31.185 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:31.182+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:31.183059+0000) 2021-08-03T12:22:31.495 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:31.492+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:31.492868+0000) 2021-08-03T12:22:31.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:31.693+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:31.694012+0000) 2021-08-03T12:22:31.738 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:31.733+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:31.734680+0000) 2021-08-03T12:22:32.095 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:32.092+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:32.093706+0000) 2021-08-03T12:22:32.420 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:32.415+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6645 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:32.459 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:32.211+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3036 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:32.495 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:32.492+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:32.493498+0000) 2021-08-03T12:22:32.711 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:32.706+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:32.707528+0000) 2021-08-03T12:22:32.908 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:32.906+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:32.907021+0000) 2021-08-03T12:22:33.096 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:33.093+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:33.094318+0000) 2021-08-03T12:22:33.383 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:33.379+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:33.380572+0000) 2021-08-03T12:22:33.496 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:33.493+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:33.494343+0000) 2021-08-03T12:22:33.609 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:33.547+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5855 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:33.941 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:33.937+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:33.938729+0000) 2021-08-03T12:22:34.097 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:34.094+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:34.094880+0000) 2021-08-03T12:22:34.269 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:34.266+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:34.267522+0000) 2021-08-03T12:22:34.497 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:34.494+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:34.495000+0000) 2021-08-03T12:22:34.819 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:34.817+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:34.817999+0000) 2021-08-03T12:22:35.097 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:35.094+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:35.095483+0000) 2021-08-03T12:22:35.416 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:35.412+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:35.413659+0000) 2021-08-03T12:22:35.498 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:35.495+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:35.495993+0000) 2021-08-03T12:22:36.098 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:36.095+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:36.096259+0000) 2021-08-03T12:22:36.482 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:36.478+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:36.479512+0000) 2021-08-03T12:22:36.499 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:36.495+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:36.496576+0000) 2021-08-03T12:22:37.099 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:37.096+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:37.096791+0000) 2021-08-03T12:22:37.318 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:37.314+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:37.315426+0000) 2021-08-03T12:22:37.500 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:37.496+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:37.497514+0000) 2021-08-03T12:22:37.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:37.778+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:37.779776+0000) 2021-08-03T12:22:38.099 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:38.096+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:38.097486+0000) 2021-08-03T12:22:38.501 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:38.497+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:38.498093+0000) 2021-08-03T12:22:38.879 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:38.877+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:38.878470+0000) 2021-08-03T12:22:38.921 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:38.919+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:38.920291+0000) 2021-08-03T12:22:39.100 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:39.097+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:39.098262+0000) 2021-08-03T12:22:39.165 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:39.136+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6654 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:39.191 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:39.189+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:39.189930+0000) 2021-08-03T12:22:39.500 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:39.498+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:39.498813+0000) 2021-08-03T12:22:39.565 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:39.326+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3039 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:40.103 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:40.098+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:40.098834+0000) 2021-08-03T12:22:40.206 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:40.203+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:40.203749+0000) 2021-08-03T12:22:40.432 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:40.253+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5868 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:40.501 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:40.498+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:40.499451+0000) 2021-08-03T12:22:40.922 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:40.916+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:40.916923+0000) 2021-08-03T12:22:41.503 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:41.500+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:41.500883+0000) 2021-08-03T12:22:41.767 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:41.763+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:41.764120+0000) 2021-08-03T12:22:42.314 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:42.311+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:42.311827+0000) 2021-08-03T12:22:42.503 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:42.500+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:42.501685+0000) 2021-08-03T12:22:43.314 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:43.311+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:43.312555+0000) 2021-08-03T12:22:43.504 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:43.501+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:43.502472+0000) 2021-08-03T12:22:43.561 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:43.557+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:43.558600+0000) 2021-08-03T12:22:43.727 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:43.725+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:43.725929+0000) 2021-08-03T12:22:44.058 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:44.056+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:44.057358+0000) 2021-08-03T12:22:44.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:44.222+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:44.223307+0000) 2021-08-03T12:22:44.315 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:44.312+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:44.313547+0000) 2021-08-03T12:22:44.505 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:44.502+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:44.503053+0000) 2021-08-03T12:22:44.747 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:44.744+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:44.745713+0000) 2021-08-03T12:22:44.786 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:44.782+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:44.783716+0000) 2021-08-03T12:22:44.808 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:44.805+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:44.806098+0000) 2021-08-03T12:22:45.316 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:45.313+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.314160+0000) 2021-08-03T12:22:45.505 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:45.502+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.503635+0000) 2021-08-03T12:22:45.641 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:45.639+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.640018+0000) 2021-08-03T12:22:45.721 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:45.634+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6661 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:45.728 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:45.571+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3040 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:45.747 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:45.745+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.745823+0000) 2021-08-03T12:22:45.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:45.776+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.777000+0000) 2021-08-03T12:22:45.786 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:45.783+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.784418+0000) 2021-08-03T12:22:45.787 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:45.784+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.784976+0000) 2021-08-03T12:22:45.834 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:45.832+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:45.833334+0000) 2021-08-03T12:22:46.136 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:46.131+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:46.132311+0000) 2021-08-03T12:22:46.330 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:46.197+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5881 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:46.508 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:46.503+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:46.504255+0000) 2021-08-03T12:22:46.747 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:46.745+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:46.745948+0000) 2021-08-03T12:22:47.091 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:47.088+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:47.088748+0000) 2021-08-03T12:22:47.764 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:47.760+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:47.761129+0000) 2021-08-03T12:22:49.507 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:49.503+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:49.503967+0000) 2021-08-03T12:22:49.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:49.794+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:49.795544+0000) 2021-08-03T12:22:49.840 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:49.838+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:49.838922+0000) 2021-08-03T12:22:49.928 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:49.925+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:49.926193+0000) 2021-08-03T12:22:50.684 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:50.646+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6678 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:51.012 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:51.008+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:51.009776+0000) 2021-08-03T12:22:51.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:51.543+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:51.543872+0000) 2021-08-03T12:22:51.779 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:51.776+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:51.776918+0000) 2021-08-03T12:22:51.834 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:51.829+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3040 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:51.950 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:51.947+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:51.948673+0000) 2021-08-03T12:22:52.013 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:52.009+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:52.010391+0000) 2021-08-03T12:22:52.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:52.178+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:52.179463+0000) 2021-08-03T12:22:52.182 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:52.180+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:52.181452+0000) 2021-08-03T12:22:53.013 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:53.010+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:53.011211+0000) 2021-08-03T12:22:53.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:53.441+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:53.442028+0000) 2021-08-03T12:22:53.445 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:53.368+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5885 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:53.695 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:22:53.691+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:53.692464+0000) 2021-08-03T12:22:53.878 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:53.874+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:53.875758+0000) 2021-08-03T12:22:54.014 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:54.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:54.012046+0000) 2021-08-03T12:22:55.015 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:55.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:55.012494+0000) 2021-08-03T12:22:55.157 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:22:55.153+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:55.154664+0000) 2021-08-03T12:22:55.175 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:55.173+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:55.174202+0000) 2021-08-03T12:22:55.281 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:22:55.277+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:55.278039+0000) 2021-08-03T12:22:55.328 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:22:55.324+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:55.325187+0000) 2021-08-03T12:22:55.635 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:55.631+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:55.632615+0000) 2021-08-03T12:22:55.877 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:22:55.743+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6681 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:22:56.015 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:56.012+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:56.013095+0000) 2021-08-03T12:22:56.359 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:56.355+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:56.357662+0000) 2021-08-03T12:22:56.477 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:22:56.473+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:56.473958+0000) 2021-08-03T12:22:56.510 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:56.506+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:56.508387+0000) 2021-08-03T12:22:57.015 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:57.012+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:57.013683+0000) 2021-08-03T12:22:57.462 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:57.457+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:57.459430+0000) 2021-08-03T12:22:57.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:57.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:57.591202+0000) 2021-08-03T12:22:57.991 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:22:57.986+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:57.988739+0000) 2021-08-03T12:22:58.006 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:22:58.003+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:58.005210+0000) 2021-08-03T12:22:58.462 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:58.458+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:58.460199+0000) 2021-08-03T12:22:58.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:58.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:58.591367+0000) 2021-08-03T12:22:58.601 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:58.598+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:58.599865+0000) 2021-08-03T12:22:59.128 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:22:59.122+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3046 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:22:59.463 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:22:59.459+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:59.460763+0000) 2021-08-03T12:22:59.593 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:22:59.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:59.591509+0000) 2021-08-03T12:22:59.674 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:22:59.669+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5888 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:22:59.676 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:22:59.670+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:22:59.672282+0000) 2021-08-03T12:23:00.593 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:00.589+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:00.591645+0000) 2021-08-03T12:23:00.945 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:00.941+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:00.943129+0000) 2021-08-03T12:23:00.975 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:00.935+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6683 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:01.009 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:01.005+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:01.007760+0000) 2021-08-03T12:23:01.623 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:01.619+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:01.620960+0000) 2021-08-03T12:23:01.785 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:01.780+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:01.782543+0000) 2021-08-03T12:23:02.009 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:02.006+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:02.007924+0000) 2021-08-03T12:23:02.109 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:02.104+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:02.106631+0000) 2021-08-03T12:23:02.623 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:02.619+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:02.621500+0000) 2021-08-03T12:23:02.714 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:02.709+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:02.711549+0000) 2021-08-03T12:23:03.009 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:03.006+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:03.008074+0000) 2021-08-03T12:23:03.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:03.136+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:03.138364+0000) 2021-08-03T12:23:03.144 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:23:03.140+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:03.142035+0000) 2021-08-03T12:23:03.638 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:03.634+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:03.636562+0000) 2021-08-03T12:23:04.009 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:04.007+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.008224+0000) 2021-08-03T12:23:04.045 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:04.040+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.041346+0000) 2021-08-03T12:23:04.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:04.127+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.129236+0000) 2021-08-03T12:23:04.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:04.366+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.366938+0000) 2021-08-03T12:23:04.492 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:04.490+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.491226+0000) 2021-08-03T12:23:04.644 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:04.640+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.641333+0000) 2021-08-03T12:23:04.669 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:04.666+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.667643+0000) 2021-08-03T12:23:04.770 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:04.767+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:04.768697+0000) 2021-08-03T12:23:05.057 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:05.052+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:05.053251+0000) 2021-08-03T12:23:05.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:05.128+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:05.129395+0000) 2021-08-03T12:23:05.643 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:05.641+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:05.641830+0000) 2021-08-03T12:23:05.676 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:05.674+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:05.675359+0000) 2021-08-03T12:23:05.771 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:05.768+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:05.769102+0000) 2021-08-03T12:23:05.851 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:05.849+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:05.850197+0000) 2021-08-03T12:23:05.861 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:05.857+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5913 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:06.645 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:06.641+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:06.642383+0000) 2021-08-03T12:23:06.771 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:06.768+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:06.769681+0000) 2021-08-03T12:23:06.875 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:06.737+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6690 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:06.897 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:06.787+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3048 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:07.148 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:07.143+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:07.144703+0000) 2021-08-03T12:23:07.150 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:07.146+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:07.146804+0000) 2021-08-03T12:23:07.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:07.527+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:07.528733+0000) 2021-08-03T12:23:07.645 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:07.642+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:07.642941+0000) 2021-08-03T12:23:07.772 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:07.769+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:07.770258+0000) 2021-08-03T12:23:08.258 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:08.254+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:08.255076+0000) 2021-08-03T12:23:08.505 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:08.502+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:08.502866+0000) 2021-08-03T12:23:08.646 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:08.643+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:08.643817+0000) 2021-08-03T12:23:08.773 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:08.770+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:08.770977+0000) 2021-08-03T12:23:09.572 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:09.569+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:09.570627+0000) 2021-08-03T12:23:09.591 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:09.589+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:09.589956+0000) 2021-08-03T12:23:09.646 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:09.643+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:09.644449+0000) 2021-08-03T12:23:09.774 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:09.771+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:09.772070+0000) 2021-08-03T12:23:10.470 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:23:10.467+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:10.467754+0000) 2021-08-03T12:23:10.573 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:10.570+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:10.571330+0000) 2021-08-03T12:23:10.647 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:10.644+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:10.645005+0000) 2021-08-03T12:23:10.775 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:10.771+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:10.772646+0000) 2021-08-03T12:23:11.574 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:11.571+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:11.571922+0000) 2021-08-03T12:23:11.635 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:11.632+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:11.633144+0000) 2021-08-03T12:23:11.648 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:11.644+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:11.645590+0000) 2021-08-03T12:23:11.776 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:11.772+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:11.773280+0000) 2021-08-03T12:23:12.575 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:12.571+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:12.572496+0000) 2021-08-03T12:23:12.636 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:12.633+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:12.633891+0000) 2021-08-03T12:23:12.648 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:12.645+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:12.646366+0000) 2021-08-03T12:23:12.776 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:12.773+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:12.774056+0000) 2021-08-03T12:23:13.284 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:13.279+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5919 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:13.383 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:13.016+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3048 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:13.575 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:13.572+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:13.573247+0000) 2021-08-03T12:23:13.651 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:13.646+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:13.646961+0000) 2021-08-03T12:23:13.727 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:13.725+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:13.726302+0000) 2021-08-03T12:23:13.744 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:13.740+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:13.741408+0000) 2021-08-03T12:23:13.775 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:13.492+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6690 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:13.776 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:13.773+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:13.774612+0000) 2021-08-03T12:23:14.650 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:14.647+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:14.647808+0000) 2021-08-03T12:23:14.777 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:14.774+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:14.774993+0000) 2021-08-03T12:23:14.817 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:14.813+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:14.814613+0000) 2021-08-03T12:23:15.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:15.717+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:15.718763+0000) 2021-08-03T12:23:15.777 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:15.774+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:15.775597+0000) 2021-08-03T12:23:15.807 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:15.803+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:15.803988+0000) 2021-08-03T12:23:16.138 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:16.135+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:16.136809+0000) 2021-08-03T12:23:16.587 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:16.584+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:16.584819+0000) 2021-08-03T12:23:16.778 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:16.775+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:16.776233+0000) 2021-08-03T12:23:17.653 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:17.649+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:17.650264+0000) 2021-08-03T12:23:17.747 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:17.745+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:17.746318+0000) 2021-08-03T12:23:17.780 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:17.776+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:17.777026+0000) 2021-08-03T12:23:18.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:18.745+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:18.746493+0000) 2021-08-03T12:23:18.780 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:18.777+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:18.778160+0000) 2021-08-03T12:23:19.464 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:19.462+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:19.463101+0000) 2021-08-03T12:23:19.590 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:19.571+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5930 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:19.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:19.745+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:19.746632+0000) 2021-08-03T12:23:19.781 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:19.778+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:19.778847+0000) 2021-08-03T12:23:19.960 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:19.957+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:19.958637+0000) 2021-08-03T12:23:20.153 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:20.100+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6714 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:20.245 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:20.241+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:20.242425+0000) 2021-08-03T12:23:20.279 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:20.277+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:20.277819+0000) 2021-08-03T12:23:20.706 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:20.703+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:20.703940+0000) 2021-08-03T12:23:20.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:20.745+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:20.746772+0000) 2021-08-03T12:23:20.782 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:20.778+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:20.779473+0000) 2021-08-03T12:23:21.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:21.262+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:21.262933+0000) 2021-08-03T12:23:21.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:21.746+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:21.746878+0000) 2021-08-03T12:23:21.782 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:21.779+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:21.780314+0000) 2021-08-03T12:23:22.165 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:22.163+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:22.163887+0000) 2021-08-03T12:23:22.703 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:22.686+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3054 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:22.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:22.746+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:22.746997+0000) 2021-08-03T12:23:22.783 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:22.780+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:22.780903+0000) 2021-08-03T12:23:23.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:23.746+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:23.747158+0000) 2021-08-03T12:23:23.784 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:23.781+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:23.782071+0000) 2021-08-03T12:23:24.283 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:24.279+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:24.280017+0000) 2021-08-03T12:23:24.748 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:24.746+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:24.747298+0000) 2021-08-03T12:23:24.785 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:24.782+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:24.782897+0000) 2021-08-03T12:23:25.279 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:25.276+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:25.277633+0000) 2021-08-03T12:23:25.313 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:25.309+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:25.310503+0000) 2021-08-03T12:23:25.749 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:25.746+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:25.747436+0000) 2021-08-03T12:23:25.785 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:25.782+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:25.783473+0000) 2021-08-03T12:23:25.932 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:25.864+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5938 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:26.280 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:26.277+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:26.278228+0000) 2021-08-03T12:23:26.550 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:26.547+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:26.548615+0000) 2021-08-03T12:23:26.644 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:26.574+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6736 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:26.648 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:26.646+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:26.646917+0000) 2021-08-03T12:23:26.749 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:26.746+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:26.747551+0000) 2021-08-03T12:23:26.787 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:26.783+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:26.784403+0000) 2021-08-03T12:23:27.281 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:27.278+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:27.279194+0000) 2021-08-03T12:23:27.715 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:27.712+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3054 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:27.749 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:27.746+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:27.747683+0000) 2021-08-03T12:23:27.787 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:27.784+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:27.785007+0000) 2021-08-03T12:23:28.029 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:28.026+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:28.027443+0000) 2021-08-03T12:23:28.282 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:28.279+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:28.280047+0000) 2021-08-03T12:23:28.388 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:28.383+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:28.384206+0000) 2021-08-03T12:23:28.788 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:28.785+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:28.785985+0000) 2021-08-03T12:23:28.794 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:28.790+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:28.791321+0000) 2021-08-03T12:23:28.828 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:28.825+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:28.826052+0000) 2021-08-03T12:23:28.986 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:28.983+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:28.984629+0000) 2021-08-03T12:23:29.283 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:29.280+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:29.280853+0000) 2021-08-03T12:23:29.789 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:29.786+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:29.786900+0000) 2021-08-03T12:23:29.829 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:29.826+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:29.827308+0000) 2021-08-03T12:23:29.988 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:29.985+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:29.986102+0000) 2021-08-03T12:23:30.107 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:30.104+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:30.105397+0000) 2021-08-03T12:23:30.283 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:30.280+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:30.281439+0000) 2021-08-03T12:23:30.789 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:30.786+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:30.787505+0000) 2021-08-03T12:23:30.830 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:30.827+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:30.828726+0000) 2021-08-03T12:23:30.989 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:30.985+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:30.986700+0000) 2021-08-03T12:23:31.108 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:31.105+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.106119+0000) 2021-08-03T12:23:31.284 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:31.281+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.282392+0000) 2021-08-03T12:23:31.461 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:31.456+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.457561+0000) 2021-08-03T12:23:31.593 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:31.591+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.592035+0000) 2021-08-03T12:23:31.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:31.698+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.699421+0000) 2021-08-03T12:23:31.790 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:31.787+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.788328+0000) 2021-08-03T12:23:31.832 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:31.829+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.829804+0000) 2021-08-03T12:23:31.879 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:31.876+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.877748+0000) 2021-08-03T12:23:31.990 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:31.987+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:31.987962+0000) 2021-08-03T12:23:32.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:32.064+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5949 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:32.109 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:32.106+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.106928+0000) 2021-08-03T12:23:32.271 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:32.267+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.268626+0000) 2021-08-03T12:23:32.285 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:32.282+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.282983+0000) 2021-08-03T12:23:32.291 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:23:32.288+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.289004+0000) 2021-08-03T12:23:32.492 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:32.489+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.489896+0000) 2021-08-03T12:23:32.513 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:32.439+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6739 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:32.593 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:32.591+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.592203+0000) 2021-08-03T12:23:32.832 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:32.829+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.830524+0000) 2021-08-03T12:23:32.881 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:32.877+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:32.878548+0000) 2021-08-03T12:23:33.286 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:33.282+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:33.283558+0000) 2021-08-03T12:23:33.593 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:33.591+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:33.592329+0000) 2021-08-03T12:23:33.833 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:33.830+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:33.831007+0000) 2021-08-03T12:23:33.881 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:33.878+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:33.879223+0000) 2021-08-03T12:23:33.965 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:32.825+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3054 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:34.517 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:34.513+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:34.514329+0000) 2021-08-03T12:23:34.594 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:34.591+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:34.592474+0000) 2021-08-03T12:23:34.834 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:34.831+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:34.831775+0000) 2021-08-03T12:23:34.882 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:34.879+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:34.879826+0000) 2021-08-03T12:23:35.433 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:35.428+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:35.429742+0000) 2021-08-03T12:23:35.594 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:35.591+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:35.592577+0000) 2021-08-03T12:23:35.834 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:35.831+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:35.832383+0000) 2021-08-03T12:23:35.882 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:35.879+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:35.880641+0000) 2021-08-03T12:23:36.292 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:36.290+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:36.291300+0000) 2021-08-03T12:23:36.594 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:36.591+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:36.592699+0000) 2021-08-03T12:23:36.680 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:36.677+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:36.678451+0000) 2021-08-03T12:23:36.835 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:36.832+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:36.832932+0000) 2021-08-03T12:23:36.884 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:36.880+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:36.881246+0000) 2021-08-03T12:23:37.155 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:37.152+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:37.153709+0000) 2021-08-03T12:23:37.361 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:37.358+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:37.359494+0000) 2021-08-03T12:23:37.594 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:37.592+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:37.592852+0000) 2021-08-03T12:23:37.615 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:37.612+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:37.612814+0000) 2021-08-03T12:23:37.770 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:37.766+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:37.767645+0000) 2021-08-03T12:23:37.835 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:37.832+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:37.833503+0000) 2021-08-03T12:23:37.885 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:37.882+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:37.883331+0000) 2021-08-03T12:23:38.362 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:38.359+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:38.360415+0000) 2021-08-03T12:23:38.594 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:38.592+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:38.593009+0000) 2021-08-03T12:23:38.836 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:38.833+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:38.834110+0000) 2021-08-03T12:23:38.887 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:38.883+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:38.884325+0000) 2021-08-03T12:23:39.009 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:38.898+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5961 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:39.037 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:38.998+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3054 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:39.299 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:39.297+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:39.297876+0000) 2021-08-03T12:23:39.363 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:39.360+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:39.360986+0000) 2021-08-03T12:23:39.594 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:39.592+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:39.593143+0000) 2021-08-03T12:23:39.774 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:39.770+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:39.771048+0000) 2021-08-03T12:23:39.813 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:39.809+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:39.810094+0000) 2021-08-03T12:23:39.836 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:39.834+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:39.834866+0000) 2021-08-03T12:23:39.886 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:39.884+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:39.884913+0000) 2021-08-03T12:23:40.363 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:40.360+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:40.361578+0000) 2021-08-03T12:23:40.594 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:40.592+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:40.593280+0000) 2021-08-03T12:23:40.706 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:40.702+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:40.703420+0000) 2021-08-03T12:23:40.804 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:40.738+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6766 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:40.837 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:40.834+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:40.835275+0000) 2021-08-03T12:23:40.887 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:40.884+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:40.885330+0000) 2021-08-03T12:23:41.364 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:41.360+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:41.362319+0000) 2021-08-03T12:23:41.595 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:41.591+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:41.593414+0000) 2021-08-03T12:23:41.811 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:41.808+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:41.808912+0000) 2021-08-03T12:23:41.837 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:41.834+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:41.835866+0000) 2021-08-03T12:23:41.888 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:41.885+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:41.885922+0000) 2021-08-03T12:23:42.366 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:42.361+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:42.363426+0000) 2021-08-03T12:23:42.734 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:42.732+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:42.733225+0000) 2021-08-03T12:23:42.838 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:42.834+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:42.836459+0000) 2021-08-03T12:23:42.889 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:42.886+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:42.887202+0000) 2021-08-03T12:23:43.419 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:23:43.413+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:43.415566+0000) 2021-08-03T12:23:43.839 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:43.835+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:43.837049+0000) 2021-08-03T12:23:43.890 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:43.887+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:43.888001+0000) 2021-08-03T12:23:44.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:44.196+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:44.197819+0000) 2021-08-03T12:23:44.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:44.565+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:44.566962+0000) 2021-08-03T12:23:44.840 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:44.835+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:44.837647+0000) 2021-08-03T12:23:44.890 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:44.887+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:44.888592+0000) 2021-08-03T12:23:45.315 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:45.310+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:45.312587+0000) 2021-08-03T12:23:45.891 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:45.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:45.889189+0000) 2021-08-03T12:23:46.014 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:45.980+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5967 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:46.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:46.043+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:46.044940+0000) 2021-08-03T12:23:46.071 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:45.426+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3054 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:46.322 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:46.318+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:46.319284+0000) 2021-08-03T12:23:46.327 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:46.324+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:46.325407+0000) 2021-08-03T12:23:46.590 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:46.454+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6775 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:46.875 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:46.870+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:46.871938+0000) 2021-08-03T12:23:46.892 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:46.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:46.889757+0000) 2021-08-03T12:23:46.908 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:46.906+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:46.906882+0000) 2021-08-03T12:23:47.328 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:47.325+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:47.326111+0000) 2021-08-03T12:23:47.871 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:23:47.866+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:47.868278+0000) 2021-08-03T12:23:48.328 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:48.325+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:48.326664+0000) 2021-08-03T12:23:48.460 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:48.455+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:48.456431+0000) 2021-08-03T12:23:48.676 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:48.672+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:48.673098+0000) 2021-08-03T12:23:48.812 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:48.809+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:48.810880+0000) 2021-08-03T12:23:49.016 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:23:49.011+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:49.013384+0000) 2021-08-03T12:23:49.222 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:23:49.217+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:49.218717+0000) 2021-08-03T12:23:49.329 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:49.326+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:49.327289+0000) 2021-08-03T12:23:49.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:49.469+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:49.470764+0000) 2021-08-03T12:23:49.678 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:49.674+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:49.675177+0000) 2021-08-03T12:23:49.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:49.911+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:49.912726+0000) 2021-08-03T12:23:50.330 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:50.327+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:50.327886+0000) 2021-08-03T12:23:50.586 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:50.584+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:50.585149+0000) 2021-08-03T12:23:50.679 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:50.675+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:50.676219+0000) 2021-08-03T12:23:50.761 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:23:50.757+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:50.758541+0000) 2021-08-03T12:23:51.330 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:51.327+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:51.328475+0000) 2021-08-03T12:23:51.679 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:51.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:51.676843+0000) 2021-08-03T12:23:52.484 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:52.390+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5994 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:52.495 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:52.493+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:52.494078+0000) 2021-08-03T12:23:52.680 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:52.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:52.677674+0000) 2021-08-03T12:23:52.803 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:52.524+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3058 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:53.530 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:53.508+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6783 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:53.536 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:23:53.532+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:53.532769+0000) 2021-08-03T12:23:53.681 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:53.677+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:53.678706+0000) 2021-08-03T12:23:53.798 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:53.796+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:53.797079+0000) 2021-08-03T12:23:54.118 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:54.114+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:54.115410+0000) 2021-08-03T12:23:54.430 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:23:54.427+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:54.428745+0000) 2021-08-03T12:23:54.678 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:54.673+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:54.674609+0000) 2021-08-03T12:23:54.681 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:54.678+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:54.679529+0000) 2021-08-03T12:23:54.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:54.740+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:54.741745+0000) 2021-08-03T12:23:55.320 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:23:55.315+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:55.316570+0000) 2021-08-03T12:23:55.682 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:55.679+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:55.680066+0000) 2021-08-03T12:23:55.968 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:55.965+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:55.966059+0000) 2021-08-03T12:23:56.341 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:56.338+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:56.339635+0000) 2021-08-03T12:23:56.635 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:23:56.631+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:56.632371+0000) 2021-08-03T12:23:56.683 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:56.679+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:56.680634+0000) 2021-08-03T12:23:56.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:23:56.712+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:56.713576+0000) 2021-08-03T12:23:56.968 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:56.965+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:56.966709+0000) 2021-08-03T12:23:57.683 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:57.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:57.681239+0000) 2021-08-03T12:23:57.969 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:57.966+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:57.967255+0000) 2021-08-03T12:23:58.646 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:23:58.321+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3060 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:23:58.684 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:58.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:58.681852+0000) 2021-08-03T12:23:58.970 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:23:58.967+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:58.967830+0000) 2021-08-03T12:23:59.490 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:23:59.439+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 5999 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:23:59.510 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:23:59.436+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6807 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:23:59.685 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:23:59.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:23:59.682431+0000) 2021-08-03T12:24:00.620 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:00.617+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:00.618372+0000) 2021-08-03T12:24:00.685 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:00.681+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:00.683162+0000) 2021-08-03T12:24:01.686 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:01.682+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:01.683749+0000) 2021-08-03T12:24:01.742 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:01.739+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:01.741338+0000) 2021-08-03T12:24:02.687 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:02.682+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:02.684560+0000) 2021-08-03T12:24:02.696 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:02.694+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:02.694981+0000) 2021-08-03T12:24:03.115 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:03.112+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:03.113033+0000) 2021-08-03T12:24:03.436 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:03.422+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3060 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:03.614 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:03.609+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:03.610785+0000) 2021-08-03T12:24:03.687 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:03.683+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:03.685132+0000) 2021-08-03T12:24:03.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:03.696+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:03.697543+0000) 2021-08-03T12:24:03.886 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:03.881+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:03.883206+0000) 2021-08-03T12:24:04.116 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:04.113+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:04.113761+0000) 2021-08-03T12:24:04.291 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:04.287+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:04.289229+0000) 2021-08-03T12:24:04.410 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:04.406+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:04.407023+0000) 2021-08-03T12:24:04.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:04.698+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:04.699092+0000) 2021-08-03T12:24:04.960 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:24:04.956+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:04.957542+0000) 2021-08-03T12:24:05.010 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:05.006+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:05.008861+0000) 2021-08-03T12:24:05.036 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:04.930+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6821 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:05.116 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:05.113+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:05.114507+0000) 2021-08-03T12:24:05.292 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:05.289+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:05.290526+0000) 2021-08-03T12:24:05.669 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:05.665+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:05.666530+0000) 2021-08-03T12:24:05.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:05.698+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:05.699214+0000) 2021-08-03T12:24:05.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:05.724+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:05.725531+0000) 2021-08-03T12:24:05.904 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:05.900+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:05.900789+0000) 2021-08-03T12:24:06.010 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:06.008+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:06.009001+0000) 2021-08-03T12:24:06.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:06.023+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:06.024223+0000) 2021-08-03T12:24:06.117 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:06.114+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:06.115135+0000) 2021-08-03T12:24:06.152 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:06.149+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:06.149805+0000) 2021-08-03T12:24:06.237 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:06.233+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:06.234742+0000) 2021-08-03T12:24:06.669 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:06.666+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:06.667259+0000) 2021-08-03T12:24:07.010 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:07.008+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.009144+0000) 2021-08-03T12:24:07.037 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:06.928+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6015 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:07.118 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:07.115+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.115734+0000) 2021-08-03T12:24:07.154 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:07.151+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.152343+0000) 2021-08-03T12:24:07.278 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:07.275+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.276743+0000) 2021-08-03T12:24:07.454 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:07.451+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.452403+0000) 2021-08-03T12:24:07.670 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:07.667+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.667867+0000) 2021-08-03T12:24:07.802 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:07.798+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.798924+0000) 2021-08-03T12:24:07.895 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:07.892+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:07.893659+0000) 2021-08-03T12:24:08.118 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:08.115+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:08.116350+0000) 2021-08-03T12:24:08.155 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:08.152+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:08.153464+0000) 2021-08-03T12:24:08.671 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:08.667+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:08.668470+0000) 2021-08-03T12:24:08.896 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:08.893+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:08.894381+0000) 2021-08-03T12:24:09.119 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:09.116+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:09.116966+0000) 2021-08-03T12:24:09.156 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:09.154+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:09.154760+0000) 2021-08-03T12:24:09.354 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:09.100+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3060 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:09.701 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:09.699+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:09.700084+0000) 2021-08-03T12:24:09.897 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:09.894+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:09.895030+0000) 2021-08-03T12:24:10.098 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:10.095+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:10.096144+0000) 2021-08-03T12:24:10.119 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:10.116+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:10.117599+0000) 2021-08-03T12:24:10.157 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:10.154+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:10.155350+0000) 2021-08-03T12:24:10.898 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:10.894+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:10.895707+0000) 2021-08-03T12:24:11.001 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:10.997+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:10.998330+0000) 2021-08-03T12:24:11.099 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:11.096+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:11.096818+0000) 2021-08-03T12:24:11.120 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:11.117+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:11.118184+0000) 2021-08-03T12:24:11.158 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:11.155+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:11.156411+0000) 2021-08-03T12:24:11.442 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:11.439+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:11.439995+0000) 2021-08-03T12:24:11.516 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:11.465+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6837 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:11.898 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:11.895+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:11.896300+0000) 2021-08-03T12:24:12.100 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:12.096+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.097403+0000) 2021-08-03T12:24:12.121 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:12.118+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.118856+0000) 2021-08-03T12:24:12.159 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:12.156+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.157337+0000) 2021-08-03T12:24:12.443 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:12.440+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.440857+0000) 2021-08-03T12:24:12.498 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:12.495+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.496743+0000) 2021-08-03T12:24:12.564 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:12.562+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.563412+0000) 2021-08-03T12:24:12.676 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:12.672+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.672809+0000) 2021-08-03T12:24:12.899 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:12.896+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:12.896941+0000) 2021-08-03T12:24:13.028 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:12.742+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6023 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:13.100 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:13.097+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:13.097989+0000) 2021-08-03T12:24:13.121 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:13.118+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:13.119435+0000) 2021-08-03T12:24:13.445 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:13.440+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:13.441591+0000) 2021-08-03T12:24:13.591 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:13.586+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:13.587273+0000) 2021-08-03T12:24:13.996 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:24:13.991+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:13.991824+0000) 2021-08-03T12:24:14.101 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:14.097+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:14.098580+0000) 2021-08-03T12:24:14.122 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:14.119+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:14.120151+0000) 2021-08-03T12:24:14.175 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:14.172+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:14.173437+0000) 2021-08-03T12:24:14.617 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:14.415+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3060 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:14.799 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:14.796+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:14.797560+0000) 2021-08-03T12:24:15.101 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:15.098+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:15.099404+0000) 2021-08-03T12:24:15.177 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:15.175+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:15.176044+0000) 2021-08-03T12:24:15.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:15.227+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:15.228226+0000) 2021-08-03T12:24:15.799 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:15.796+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:15.797693+0000) 2021-08-03T12:24:15.957 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:15.952+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:15.953585+0000) 2021-08-03T12:24:16.136 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:16.131+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:16.132599+0000) 2021-08-03T12:24:16.601 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:16.597+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:16.598025+0000) 2021-08-03T12:24:16.799 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:16.797+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:16.797843+0000) 2021-08-03T12:24:17.218 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:17.213+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:17.214675+0000) 2021-08-03T12:24:17.326 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:17.322+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:17.323579+0000) 2021-08-03T12:24:17.579 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:17.558+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6844 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:17.799 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:17.797+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:17.797971+0000) 2021-08-03T12:24:17.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:17.972+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:17.973148+0000) 2021-08-03T12:24:18.528 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:18.525+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:18.526671+0000) 2021-08-03T12:24:18.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:18.747+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:18.748285+0000) 2021-08-03T12:24:18.803 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:18.798+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:18.799349+0000) 2021-08-03T12:24:19.088 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:19.084+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:19.084934+0000) 2021-08-03T12:24:19.122 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:19.098+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6033 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:19.368 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:19.363+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:19.364235+0000) 2021-08-03T12:24:19.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:19.747+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:19.748426+0000) 2021-08-03T12:24:20.479 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:20.476+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:20.477423+0000) 2021-08-03T12:24:20.502 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:20.500+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:20.500871+0000) 2021-08-03T12:24:20.771 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:20.769+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:20.770157+0000) 2021-08-03T12:24:21.199 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:21.196+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:21.196851+0000) 2021-08-03T12:24:21.207 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:21.205+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:21.206118+0000) 2021-08-03T12:24:21.984 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:21.469+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3060 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:22.168 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:22.165+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:22.166530+0000) 2021-08-03T12:24:22.200 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:22.196+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:22.197648+0000) 2021-08-03T12:24:22.384 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:24:22.379+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:22.380169+0000) 2021-08-03T12:24:22.465 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:22.461+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:22.462147+0000) 2021-08-03T12:24:22.659 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:22.656+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:22.656852+0000) 2021-08-03T12:24:23.011 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:23.006+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:23.007337+0000) 2021-08-03T12:24:23.200 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:23.197+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:23.198357+0000) 2021-08-03T12:24:24.010 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:24.007+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:24.008340+0000) 2021-08-03T12:24:24.201 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:24.198+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:24.199146+0000) 2021-08-03T12:24:24.693 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:24.682+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6854 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:25.011 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:25.008+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:25.009105+0000) 2021-08-03T12:24:25.202 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:25.199+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:25.199976+0000) 2021-08-03T12:24:25.388 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:25.384+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:25.384936+0000) 2021-08-03T12:24:25.819 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:25.719+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6060 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:25.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:25.819+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:25.820165+0000) 2021-08-03T12:24:26.012 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:26.009+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:26.009912+0000) 2021-08-03T12:24:26.203 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:26.199+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:26.200780+0000) 2021-08-03T12:24:27.013 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:27.009+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:27.010751+0000) 2021-08-03T12:24:27.101 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:27.097+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:27.099609+0000) 2021-08-03T12:24:27.203 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:27.200+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:27.201379+0000) 2021-08-03T12:24:27.317 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:27.311+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:27.313400+0000) 2021-08-03T12:24:28.013 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:28.010+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:28.011319+0000) 2021-08-03T12:24:28.205 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:28.202+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:28.202871+0000) 2021-08-03T12:24:29.014 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:29.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:29.011854+0000) 2021-08-03T12:24:29.206 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:29.202+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:29.203620+0000) 2021-08-03T12:24:30.015 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:30.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:30.012421+0000) 2021-08-03T12:24:30.206 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:30.203+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:30.204185+0000) 2021-08-03T12:24:30.414 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:30.355+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3060 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:30.768 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:30.763+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:30.765033+0000) 2021-08-03T12:24:31.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:31.013+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:31.014028+0000) 2021-08-03T12:24:31.016 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:31.012+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:31.013056+0000) 2021-08-03T12:24:31.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:31.021+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:31.023293+0000) 2021-08-03T12:24:31.207 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:31.203+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:31.204767+0000) 2021-08-03T12:24:31.595 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:31.592+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:31.594047+0000) 2021-08-03T12:24:31.679 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:31.675+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:31.676312+0000) 2021-08-03T12:24:32.016 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:32.012+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:32.013767+0000) 2021-08-03T12:24:32.207 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:32.204+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:32.205375+0000) 2021-08-03T12:24:32.437 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:24:32.432+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:32.434055+0000) 2021-08-03T12:24:32.586 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:32.582+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:32.583880+0000) 2021-08-03T12:24:32.591 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:32.422+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6880 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:32.911 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:32.889+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6074 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:33.016 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:33.013+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:33.014367+0000) 2021-08-03T12:24:33.115 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:33.111+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:33.113720+0000) 2021-08-03T12:24:33.208 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:33.205+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:33.206149+0000) 2021-08-03T12:24:33.835 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:33.830+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:33.832348+0000) 2021-08-03T12:24:34.017 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:34.014+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:34.015191+0000) 2021-08-03T12:24:34.209 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:34.206+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:34.207015+0000) 2021-08-03T12:24:34.608 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:34.606+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:34.606969+0000) 2021-08-03T12:24:35.018 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:35.015+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:35.015783+0000) 2021-08-03T12:24:35.127 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:35.123+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:35.124503+0000) 2021-08-03T12:24:35.210 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:35.207+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:35.207831+0000) 2021-08-03T12:24:35.369 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:35.364+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:35.365381+0000) 2021-08-03T12:24:35.814 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:35.812+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:35.813046+0000) 2021-08-03T12:24:35.946 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:35.943+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:35.944649+0000) 2021-08-03T12:24:36.019 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:36.015+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.016600+0000) 2021-08-03T12:24:36.127 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:36.124+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.125220+0000) 2021-08-03T12:24:36.147 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:36.141+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.142205+0000) 2021-08-03T12:24:36.184 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:24:36.180+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.181418+0000) 2021-08-03T12:24:36.210 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:36.207+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.208533+0000) 2021-08-03T12:24:36.299 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:36.295+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.296591+0000) 2021-08-03T12:24:36.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:36.698+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.699723+0000) 2021-08-03T12:24:36.948 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:36.944+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:36.945399+0000) 2021-08-03T12:24:37.020 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:37.016+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:37.017447+0000) 2021-08-03T12:24:37.128 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:37.125+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:37.125809+0000) 2021-08-03T12:24:37.211 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:37.208+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:37.209390+0000) 2021-08-03T12:24:37.300 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:37.296+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:37.297213+0000) 2021-08-03T12:24:37.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:37.701+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:37.702316+0000) 2021-08-03T12:24:37.935 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:37.930+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3064 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:37.948 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:37.945+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:37.945966+0000) 2021-08-03T12:24:38.011 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:38.008+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.009704+0000) 2021-08-03T12:24:38.020 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:38.017+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.018314+0000) 2021-08-03T12:24:38.128 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:38.125+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.126446+0000) 2021-08-03T12:24:38.212 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:38.209+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.209987+0000) 2021-08-03T12:24:38.300 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:38.297+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.297867+0000) 2021-08-03T12:24:38.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:38.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.703900+0000) 2021-08-03T12:24:38.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:38.797+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.798332+0000) 2021-08-03T12:24:38.833 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:38.830+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.831582+0000) 2021-08-03T12:24:38.949 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:38.945+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:38.946567+0000) 2021-08-03T12:24:39.011 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:39.008+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.009858+0000) 2021-08-03T12:24:39.021 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:39.018+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.019089+0000) 2021-08-03T12:24:39.129 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:39.126+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.127242+0000) 2021-08-03T12:24:39.213 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:39.209+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.210612+0000) 2021-08-03T12:24:39.301 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:39.297+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.298519+0000) 2021-08-03T12:24:39.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:39.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.704038+0000) 2021-08-03T12:24:39.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:39.797+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.798481+0000) 2021-08-03T12:24:39.950 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:39.946+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:39.947165+0000) 2021-08-03T12:24:40.011 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:40.009+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:40.010006+0000) 2021-08-03T12:24:40.021 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:40.018+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:40.019675+0000) 2021-08-03T12:24:40.130 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:24:40.127+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:40.127844+0000) 2021-08-03T12:24:40.213 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:40.210+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:40.211435+0000) 2021-08-03T12:24:40.301 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:40.298+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:40.299330+0000) 2021-08-03T12:24:40.344 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:40.229+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6090 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:40.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:40.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:40.704245+0000) 2021-08-03T12:24:40.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:40.797+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:40.798621+0000) 2021-08-03T12:24:41.011 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:41.009+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:41.010144+0000) 2021-08-03T12:24:41.022 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:41.019+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:41.020281+0000) 2021-08-03T12:24:41.061 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:40.951+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6888 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:41.214 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:41.211+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:41.212014+0000) 2021-08-03T12:24:41.302 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:41.299+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:41.299964+0000) 2021-08-03T12:24:41.424 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:41.417+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:41.418591+0000) 2021-08-03T12:24:41.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:41.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:41.704407+0000) 2021-08-03T12:24:41.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:41.797+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:41.798751+0000) 2021-08-03T12:24:42.023 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:42.020+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.020895+0000) 2021-08-03T12:24:42.043 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:42.039+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.040192+0000) 2021-08-03T12:24:42.215 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:42.212+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.212883+0000) 2021-08-03T12:24:42.303 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:42.299+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.300561+0000) 2021-08-03T12:24:42.421 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:42.418+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.419297+0000) 2021-08-03T12:24:42.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:42.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.704631+0000) 2021-08-03T12:24:42.723 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:42.720+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.721446+0000) 2021-08-03T12:24:42.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:42.798+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:42.798886+0000) 2021-08-03T12:24:43.024 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:43.020+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:43.021708+0000) 2021-08-03T12:24:43.216 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:43.213+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:43.213870+0000) 2021-08-03T12:24:43.304 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:43.300+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:43.301624+0000) 2021-08-03T12:24:43.422 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:43.419+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:43.419891+0000) 2021-08-03T12:24:43.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:43.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:43.704780+0000) 2021-08-03T12:24:43.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:43.798+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:43.799043+0000) 2021-08-03T12:24:43.840 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:24:43.836+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:43.837359+0000) 2021-08-03T12:24:44.024 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:44.021+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:44.022466+0000) 2021-08-03T12:24:44.216 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:44.213+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:44.214476+0000) 2021-08-03T12:24:44.304 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:44.301+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:44.302241+0000) 2021-08-03T12:24:44.422 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:44.419+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:44.420501+0000) 2021-08-03T12:24:44.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:44.704+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:44.705040+0000) 2021-08-03T12:24:44.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:44.798+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:44.799174+0000) 2021-08-03T12:24:45.025 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:45.022+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:45.023128+0000) 2021-08-03T12:24:45.217 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:45.214+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:45.215029+0000) 2021-08-03T12:24:45.305 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:45.302+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:45.302841+0000) 2021-08-03T12:24:45.362 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:44.808+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3071 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:45.423 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:45.420+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:45.421081+0000) 2021-08-03T12:24:45.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:45.798+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:45.799296+0000) 2021-08-03T12:24:46.027 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:46.023+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:46.023960+0000) 2021-08-03T12:24:46.038 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:46.035+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:46.035833+0000) 2021-08-03T12:24:46.217 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:46.214+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:46.215564+0000) 2021-08-03T12:24:46.306 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:46.302+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:46.303468+0000) 2021-08-03T12:24:46.423 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:46.420+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:46.421635+0000) 2021-08-03T12:24:46.526 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:46.464+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6098 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:46.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:46.798+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:46.799456+0000) 2021-08-03T12:24:47.026 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:47.023+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:47.024611+0000) 2021-08-03T12:24:47.087 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:47.082+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:47.083295+0000) 2021-08-03T12:24:47.306 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:47.303+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:47.304260+0000) 2021-08-03T12:24:47.424 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:47.421+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:47.422148+0000) 2021-08-03T12:24:47.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:47.798+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:47.799610+0000) 2021-08-03T12:24:48.028 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:48.024+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:48.025623+0000) 2021-08-03T12:24:48.059 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:48.056+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:48.057478+0000) 2021-08-03T12:24:48.307 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:48.304+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:48.304862+0000) 2021-08-03T12:24:48.425 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:48.422+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:48.423081+0000) 2021-08-03T12:24:48.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:48.798+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:48.799767+0000) 2021-08-03T12:24:49.028 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:49.025+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:49.026470+0000) 2021-08-03T12:24:49.308 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:49.305+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:49.305935+0000) 2021-08-03T12:24:49.347 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:49.074+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6905 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:49.426 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:49.423+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:49.423903+0000) 2021-08-03T12:24:49.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:49.799+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:49.799899+0000) 2021-08-03T12:24:50.030 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:50.026+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:50.027687+0000) 2021-08-03T12:24:50.146 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:24:50.142+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:50.143168+0000) 2021-08-03T12:24:50.309 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:50.305+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:50.306566+0000) 2021-08-03T12:24:50.426 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:50.423+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:50.424527+0000) 2021-08-03T12:24:50.708 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:24:50.704+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:50.704949+0000) 2021-08-03T12:24:50.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:50.799+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:50.800061+0000) 2021-08-03T12:24:51.028 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:51.010+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3075 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:51.030 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:51.027+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:51.028277+0000) 2021-08-03T12:24:51.310 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:51.306+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:51.307186+0000) 2021-08-03T12:24:51.428 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:51.425+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:51.425784+0000) 2021-08-03T12:24:51.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:51.651+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:51.652340+0000) 2021-08-03T12:24:51.802 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:51.799+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:51.800193+0000) 2021-08-03T12:24:52.031 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:52.028+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:52.029198+0000) 2021-08-03T12:24:52.310 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:52.307+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:52.308020+0000) 2021-08-03T12:24:52.429 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:52.425+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:52.426485+0000) 2021-08-03T12:24:52.802 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:52.799+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:52.800354+0000) 2021-08-03T12:24:52.842 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:52.744+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6121 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:53.034 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:24:53.028+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:53.029789+0000) 2021-08-03T12:24:53.311 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:53.307+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:53.308618+0000) 2021-08-03T12:24:53.429 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:53.426+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:53.427061+0000) 2021-08-03T12:24:53.802 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:53.799+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:53.800506+0000) 2021-08-03T12:24:53.902 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:24:53.899+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:53.900790+0000) 2021-08-03T12:24:54.311 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:54.308+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:54.309256+0000) 2021-08-03T12:24:54.430 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:54.426+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:54.427659+0000) 2021-08-03T12:24:54.802 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:54.799+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:54.800653+0000) 2021-08-03T12:24:55.133 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:24:55.129+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:55.130079+0000) 2021-08-03T12:24:55.312 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:55.309+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:55.310221+0000) 2021-08-03T12:24:55.316 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:24:55.279+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6913 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:24:55.430 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:55.427+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:55.428236+0000) 2021-08-03T12:24:55.802 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:55.799+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:55.800793+0000) 2021-08-03T12:24:56.314 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:56.310+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:56.311193+0000) 2021-08-03T12:24:56.431 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:56.428+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:56.428805+0000) 2021-08-03T12:24:56.802 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:56.800+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:56.800940+0000) 2021-08-03T12:24:57.265 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:24:57.261+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:57.262049+0000) 2021-08-03T12:24:57.314 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:57.311+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:57.311878+0000) 2021-08-03T12:24:57.431 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:57.428+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:57.429438+0000) 2021-08-03T12:24:57.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:57.795+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:57.795881+0000) 2021-08-03T12:24:57.802 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:57.800+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:57.801053+0000) 2021-08-03T12:24:58.300 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:24:58.100+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3082 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:24:58.314 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:58.311+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:58.312472+0000) 2021-08-03T12:24:58.432 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:24:58.429+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:58.430062+0000) 2021-08-03T12:24:58.435 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:24:58.406+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6126 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:24:58.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:58.445+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:58.446634+0000) 2021-08-03T12:24:58.803 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:24:58.800+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:58.801188+0000) 2021-08-03T12:24:59.315 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:24:59.312+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:24:59.313010+0000) 2021-08-03T12:25:00.316 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:00.311+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:00.313616+0000) 2021-08-03T12:25:00.331 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:00.329+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:00.330221+0000) 2021-08-03T12:25:00.443 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:00.438+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:00.439898+0000) 2021-08-03T12:25:00.473 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:00.467+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6915 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:01.316 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:01.312+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:01.314212+0000) 2021-08-03T12:25:01.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:01.752+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:01.753254+0000) 2021-08-03T12:25:02.317 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:02.313+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:02.314822+0000) 2021-08-03T12:25:02.596 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:02.593+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:02.594400+0000) 2021-08-03T12:25:02.844 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:02.840+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:02.840943+0000) 2021-08-03T12:25:03.091 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:03.087+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:03.088092+0000) 2021-08-03T12:25:03.318 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:03.313+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:03.315659+0000) 2021-08-03T12:25:03.596 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:03.593+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:03.594556+0000) 2021-08-03T12:25:03.737 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:03.734+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:03.735075+0000) 2021-08-03T12:25:04.289 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:04.284+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:04.286610+0000) 2021-08-03T12:25:04.318 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:04.314+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:04.316502+0000) 2021-08-03T12:25:04.596 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:04.593+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:04.594688+0000) 2021-08-03T12:25:04.738 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:04.735+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:04.735751+0000) 2021-08-03T12:25:04.984 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:04.979+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6133 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:05.320 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:05.315+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:05.317617+0000) 2021-08-03T12:25:05.596 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:05.594+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:05.594845+0000) 2021-08-03T12:25:05.752 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:05.669+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6917 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:05.800 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:25:05.758+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:25:06.321 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:06.316+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:06.318689+0000) 2021-08-03T12:25:06.331 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:25:06.326+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:06.328615+0000) 2021-08-03T12:25:06.596 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:06.594+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:06.594987+0000) 2021-08-03T12:25:07.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:07.268+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:07.269492+0000) 2021-08-03T12:25:07.322 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:07.318+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:07.319580+0000) 2021-08-03T12:25:07.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:07.594+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:07.595133+0000) 2021-08-03T12:25:08.322 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:08.319+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:08.320198+0000) 2021-08-03T12:25:08.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:08.594+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:08.595289+0000) 2021-08-03T12:25:08.634 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:08.631+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:08.632581+0000) 2021-08-03T12:25:08.636 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:25:08.633+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:08.634695+0000) 2021-08-03T12:25:09.323 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:09.320+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:09.321470+0000) 2021-08-03T12:25:09.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:09.594+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:09.595398+0000) 2021-08-03T12:25:10.324 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:10.321+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:10.322104+0000) 2021-08-03T12:25:10.537 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:10.532+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:10.533354+0000) 2021-08-03T12:25:10.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:10.594+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:10.595503+0000) 2021-08-03T12:25:11.325 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:11.322+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:11.322939+0000) 2021-08-03T12:25:11.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:11.593+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:11.595653+0000) 2021-08-03T12:25:11.667 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:11.632+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:11.870 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:11.866+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:11.868284+0000) 2021-08-03T12:25:12.012 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:25:12.009+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:12.010506+0000) 2021-08-03T12:25:12.326 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:12.323+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:12.323823+0000) 2021-08-03T12:25:12.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:12.594+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:12.595817+0000) 2021-08-03T12:25:12.836 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:12.832+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:12.834007+0000) 2021-08-03T12:25:13.076 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:12.914+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6145 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:13.327 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:13.323+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:13.324625+0000) 2021-08-03T12:25:14.294 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:14.288+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:14.290669+0000) 2021-08-03T12:25:14.327 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:14.324+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:14.325185+0000) 2021-08-03T12:25:14.927 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:25:14.922+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:14.923977+0000) 2021-08-03T12:25:15.057 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:15.053+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:15.053884+0000) 2021-08-03T12:25:15.328 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:15.324+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:15.325767+0000) 2021-08-03T12:25:15.474 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:25:15.301+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:25:15.546 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:25:15.543+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:15.544520+0000) 2021-08-03T12:25:16.328 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:16.325+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:16.326383+0000) 2021-08-03T12:25:16.839 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:16.835+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:16.837224+0000) 2021-08-03T12:25:16.853 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:16.849+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:16.851529+0000) 2021-08-03T12:25:17.667 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:17.656+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:17.851 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:17.846+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:17.848575+0000) 2021-08-03T12:25:18.080 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:18.076+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:18.077109+0000) 2021-08-03T12:25:19.200 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:19.196+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:19.197090+0000) 2021-08-03T12:25:19.292 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:19.288+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:19.289739+0000) 2021-08-03T12:25:19.321 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:19.277+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6152 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:20.292 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:20.289+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:20.290377+0000) 2021-08-03T12:25:20.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:20.653+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:20.654384+0000) 2021-08-03T12:25:20.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:20.748+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:20.749062+0000) 2021-08-03T12:25:21.293 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:21.290+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:21.290965+0000) 2021-08-03T12:25:21.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:21.748+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:21.749199+0000) 2021-08-03T12:25:22.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:22.023+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:22.024092+0000) 2021-08-03T12:25:22.260 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:22.257+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:22.258539+0000) 2021-08-03T12:25:22.294 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:22.290+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:22.291530+0000) 2021-08-03T12:25:22.295 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:22.292+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:22.293316+0000) 2021-08-03T12:25:22.511 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:25:22.508+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:22.509428+0000) 2021-08-03T12:25:22.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:22.748+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:22.749363+0000) 2021-08-03T12:25:22.759 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:22.722+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:22.847 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:25:22.842+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:22.843283+0000) 2021-08-03T12:25:23.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:23.023+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:23.024248+0000) 2021-08-03T12:25:23.261 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:23.258+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:23.259120+0000) 2021-08-03T12:25:23.294 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:23.291+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:23.292126+0000) 2021-08-03T12:25:23.483 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:23.478+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:23.479658+0000) 2021-08-03T12:25:23.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:23.748+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:23.749478+0000) 2021-08-03T12:25:24.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:24.023+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:24.024370+0000) 2021-08-03T12:25:24.263 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:24.259+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:24.259905+0000) 2021-08-03T12:25:24.298 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:24.292+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:24.293072+0000) 2021-08-03T12:25:24.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:24.748+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:24.749605+0000) 2021-08-03T12:25:24.754 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:24.751+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:24.751739+0000) 2021-08-03T12:25:24.895 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:25:24.363+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:25:25.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:25.023+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:25.024533+0000) 2021-08-03T12:25:25.263 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:25.259+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:25.260591+0000) 2021-08-03T12:25:25.296 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:25.293+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:25.294362+0000) 2021-08-03T12:25:25.461 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:25.458+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:25.459611+0000) 2021-08-03T12:25:25.506 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:25.502+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:25.503315+0000) 2021-08-03T12:25:25.754 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:25.751+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:25.752482+0000) 2021-08-03T12:25:25.892 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:25.559+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6160 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:26.264 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:26.260+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:26.261446+0000) 2021-08-03T12:25:26.297 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:26.294+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:26.294946+0000) 2021-08-03T12:25:26.755 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:26.752+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:26.752917+0000) 2021-08-03T12:25:27.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:27.752+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:27.753453+0000) 2021-08-03T12:25:28.526 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:28.522+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:28.523297+0000) 2021-08-03T12:25:28.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:28.753+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:28.754027+0000) 2021-08-03T12:25:28.859 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:28.854+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:28.855247+0000) 2021-08-03T12:25:28.860 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:25:28.855+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:28.856543+0000) 2021-08-03T12:25:29.526 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:29.523+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:29.523985+0000) 2021-08-03T12:25:29.757 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:29.753+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:29.754629+0000) 2021-08-03T12:25:30.220 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:25:30.126+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:25:30.487 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:30.483+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:30.484427+0000) 2021-08-03T12:25:30.518 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:30.514+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:30.527 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:30.523+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:30.524558+0000) 2021-08-03T12:25:30.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:30.528+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:30.529603+0000) 2021-08-03T12:25:30.593 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:25:30.590+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:30.591203+0000) 2021-08-03T12:25:30.608 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:30.603+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:30.604622+0000) 2021-08-03T12:25:30.757 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:30.754+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:30.755207+0000) 2021-08-03T12:25:31.137 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:25:31.133+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.134271+0000) 2021-08-03T12:25:31.161 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:31.157+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.158532+0000) 2021-08-03T12:25:31.175 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:31.171+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.172419+0000) 2021-08-03T12:25:31.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:31.198+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.199677+0000) 2021-08-03T12:25:31.205 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:31.175+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6179 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:31.487 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:31.484+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.485089+0000) 2021-08-03T12:25:31.527 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:31.524+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.525140+0000) 2021-08-03T12:25:31.680 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:31.677+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.678519+0000) 2021-08-03T12:25:31.758 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:31.755+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:31.755802+0000) 2021-08-03T12:25:32.598 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:32.595+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:32.596083+0000) 2021-08-03T12:25:33.033 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:33.030+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:33.031309+0000) 2021-08-03T12:25:33.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:33.472+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:33.472829+0000) 2021-08-03T12:25:33.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:33.595+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:33.596182+0000) 2021-08-03T12:25:34.598 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:34.595+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:34.596305+0000) 2021-08-03T12:25:35.598 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:35.595+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:35.596425+0000) 2021-08-03T12:25:35.917 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:25:35.914+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:25:36.161 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:36.157+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:36.158501+0000) 2021-08-03T12:25:36.598 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:36.595+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:36.596548+0000) 2021-08-03T12:25:37.119 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:25:37.113+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:37.114335+0000) 2021-08-03T12:25:37.161 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:37.158+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:37.159277+0000) 2021-08-03T12:25:37.365 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:37.361+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:37.362053+0000) 2021-08-03T12:25:37.371 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:37.345+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:37.426 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:37.422+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:37.422948+0000) 2021-08-03T12:25:37.598 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:37.595+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:37.596681+0000) 2021-08-03T12:25:37.663 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:37.658+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:37.659530+0000) 2021-08-03T12:25:38.162 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:38.159+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:38.159931+0000) 2021-08-03T12:25:38.216 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:38.212+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:38.213125+0000) 2021-08-03T12:25:38.365 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:38.361+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:38.362734+0000) 2021-08-03T12:25:38.499 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:38.314+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6202 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:38.741 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:25:38.736+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:38.737284+0000) 2021-08-03T12:25:39.163 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:39.159+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:39.160740+0000) 2021-08-03T12:25:39.921 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:39.918+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:39.919285+0000) 2021-08-03T12:25:40.164 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:40.160+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:40.161710+0000) 2021-08-03T12:25:40.185 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:40.181+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:40.182120+0000) 2021-08-03T12:25:40.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:40.795+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:40.795949+0000) 2021-08-03T12:25:41.107 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:25:41.103+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:25:41.165 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:41.161+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:41.162547+0000) 2021-08-03T12:25:42.165 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:42.162+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:42.163374+0000) 2021-08-03T12:25:43.115 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:43.111+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:43.112259+0000) 2021-08-03T12:25:43.166 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:43.163+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:43.163979+0000) 2021-08-03T12:25:43.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:43.652+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:43.653369+0000) 2021-08-03T12:25:43.829 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:43.775+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6209 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:43.881 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:25:43.877+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:43.878527+0000) 2021-08-03T12:25:45.567 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:45.448+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:45.634 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:45.631+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:45.632424+0000) 2021-08-03T12:25:45.707 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:45.705+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:45.705835+0000) 2021-08-03T12:25:46.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:46.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:46.708430+0000) 2021-08-03T12:25:47.681 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:25:47.678+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:47.679850+0000) 2021-08-03T12:25:47.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:47.709+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:47.710071+0000) 2021-08-03T12:25:48.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:48.709+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:48.710282+0000) 2021-08-03T12:25:49.034 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:49.028+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:49.029796+0000) 2021-08-03T12:25:49.302 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:49.299+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:49.300370+0000) 2021-08-03T12:25:49.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:49.709+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:49.710425+0000) 2021-08-03T12:25:50.177 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:50.172+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:50.173765+0000) 2021-08-03T12:25:50.260 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:50.183+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6228 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:50.616 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:50.612+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:50.612893+0000) 2021-08-03T12:25:50.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:50.709+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:50.710624+0000) 2021-08-03T12:25:50.716 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:25:50.711+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:50.712120+0000) 2021-08-03T12:25:50.742 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:50.737+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:50.738641+0000) 2021-08-03T12:25:50.777 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:25:50.773+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:50.774271+0000) 2021-08-03T12:25:50.781 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:25:50.777+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:50.778132+0000) 2021-08-03T12:25:51.713 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:51.709+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:51.710739+0000) 2021-08-03T12:25:52.232 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:25:52.111+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:25:52.713 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:52.710+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:52.711005+0000) 2021-08-03T12:25:52.818 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:52.814+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:52.815305+0000) 2021-08-03T12:25:52.899 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:25:52.779+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:25:53.713 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:53.710+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:53.711156+0000) 2021-08-03T12:25:54.557 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:54.554+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:54.554786+0000) 2021-08-03T12:25:55.314 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:55.309+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:55.310374+0000) 2021-08-03T12:25:55.558 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:55.554+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:55.555781+0000) 2021-08-03T12:25:56.314 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:56.311+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:56.311965+0000) 2021-08-03T12:25:56.559 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:56.555+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:56.556367+0000) 2021-08-03T12:25:57.315 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:57.310+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:57.312544+0000) 2021-08-03T12:25:57.559 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:57.556+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:57.556953+0000) 2021-08-03T12:25:57.784 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:25:57.776+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6260 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:25:57.788 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:25:57.783+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:57.784242+0000) 2021-08-03T12:25:57.805 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:25:57.802+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:57.804009+0000) 2021-08-03T12:25:58.014 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:25:58.011+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:58.012880+0000) 2021-08-03T12:25:58.316 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:58.311+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:58.313303+0000) 2021-08-03T12:25:58.560 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:58.556+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:58.557559+0000) 2021-08-03T12:25:59.317 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:25:59.312+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:59.314219+0000) 2021-08-03T12:25:59.553 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:25:59.548+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:59.549651+0000) 2021-08-03T12:25:59.560 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:25:59.557+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:25:59.558377+0000) 2021-08-03T12:26:00.094 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:00.089+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:00.090886+0000) 2021-08-03T12:26:00.317 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:26:00.313+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:00.314868+0000) 2021-08-03T12:26:00.571 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:26:00.563+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:00.562652+0000) 2021-08-03T12:26:01.144 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:26:01.080+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:26:01.162 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:00.908+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:01.895 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:01.892+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:01.894021+0000) 2021-08-03T12:26:02.142 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:02.137+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:02.139609+0000) 2021-08-03T12:26:03.143 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:03.138+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:03.140348+0000) 2021-08-03T12:26:04.143 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:04.139+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:04.140993+0000) 2021-08-03T12:26:04.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:04.220+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:04.222491+0000) 2021-08-03T12:26:04.229 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:26:04.223+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:04.225522+0000) 2021-08-03T12:26:04.333 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:26:04.327+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:04.329432+0000) 2021-08-03T12:26:04.379 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:04.355+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6279 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:05.121 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:26:05.117+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:05.118320+0000) 2021-08-03T12:26:05.144 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:05.141+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:05.141781+0000) 2021-08-03T12:26:05.275 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:05.270+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:05.272605+0000) 2021-08-03T12:26:05.760 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:05.757+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:05.758495+0000) 2021-08-03T12:26:06.145 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:06.141+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:06.142432+0000) 2021-08-03T12:26:07.146 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:07.142+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:07.143035+0000) 2021-08-03T12:26:08.146 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:08.142+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:08.143623+0000) 2021-08-03T12:26:09.146 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:09.143+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:09.144162+0000) 2021-08-03T12:26:09.383 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:09.378+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:09.378899+0000) 2021-08-03T12:26:09.398 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:26:09.394+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:26:10.147 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:10.144+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:10.144769+0000) 2021-08-03T12:26:10.727 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:26:10.722+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:10.722912+0000) 2021-08-03T12:26:11.086 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:11.082+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:11.082819+0000) 2021-08-03T12:26:11.184 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:11.144+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:11.145378+0000) 2021-08-03T12:26:11.185 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:11.171+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:11.487 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:11.390+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6292 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:11.518 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:11.515+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:11.516774+0000) 2021-08-03T12:26:12.148 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:12.145+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:12.145820+0000) 2021-08-03T12:26:13.149 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:13.145+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:13.146531+0000) 2021-08-03T12:26:14.149 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:14.146+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:14.147131+0000) 2021-08-03T12:26:14.642 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:14.639+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:14.640648+0000) 2021-08-03T12:26:15.151 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:15.147+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:15.147880+0000) 2021-08-03T12:26:15.496 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:15.493+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:15.494590+0000) 2021-08-03T12:26:15.903 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:15.899+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:15.899328+0000) 2021-08-03T12:26:16.151 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:16.147+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:16.148690+0000) 2021-08-03T12:26:16.213 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:16.208+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:16.209360+0000) 2021-08-03T12:26:16.532 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:26:16.527+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:16.528730+0000) 2021-08-03T12:26:16.636 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:26:16.634+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:16.635082+0000) 2021-08-03T12:26:17.152 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:17.148+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:17.149555+0000) 2021-08-03T12:26:17.299 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:17.296+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:17.297591+0000) 2021-08-03T12:26:18.093 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:18.089+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:18.089880+0000) 2021-08-03T12:26:18.111 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:18.092+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:18.181 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:17.955+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6309 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:18.746 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:26:17.224+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:26:20.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:20.245+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:20.245867+0000) 2021-08-03T12:26:20.989 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:20.984+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:20.984966+0000) 2021-08-03T12:26:22.713 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:22.710+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:22.711432+0000) 2021-08-03T12:26:23.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:23.786+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:23.787059+0000) 2021-08-03T12:26:24.281 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:24.268+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6315 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:24.301 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:24.298+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6924 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:24.713 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:24.710+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:24.711596+0000) 2021-08-03T12:26:25.022 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:25.020+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:25.020947+0000) 2021-08-03T12:26:25.304 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:25.299+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:25.300663+0000) 2021-08-03T12:26:25.364 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:26:25.359+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:25.360479+0000) 2021-08-03T12:26:25.562 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:25.558+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:25.559576+0000) 2021-08-03T12:26:25.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:25.715+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:25.715863+0000) 2021-08-03T12:26:25.842 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:26:25.597+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:26:25.964 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:26:25.960+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:25.961116+0000) 2021-08-03T12:26:26.403 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:26.399+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:26.400686+0000) 2021-08-03T12:26:26.863 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:26:26.859+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:26.860117+0000) 2021-08-03T12:26:27.404 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:27.400+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:27.401654+0000) 2021-08-03T12:26:28.404 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:28.401+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:28.402218+0000) 2021-08-03T12:26:28.599 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:28.596+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:28.597420+0000) 2021-08-03T12:26:28.689 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:28.685+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:28.685986+0000) 2021-08-03T12:26:28.875 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:26:28.871+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:28.871982+0000) 2021-08-03T12:26:29.360 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:29.357+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:29.358754+0000) 2021-08-03T12:26:29.406 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:29.402+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:29.403317+0000) 2021-08-03T12:26:29.599 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:29.596+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:29.597551+0000) 2021-08-03T12:26:30.126 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:30.123+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:30.124499+0000) 2021-08-03T12:26:30.206 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:26:30.203+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:30.204207+0000) 2021-08-03T12:26:30.360 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:30.358+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:30.358902+0000) 2021-08-03T12:26:30.406 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:30.403+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:30.404115+0000) 2021-08-03T12:26:30.545 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:30.539+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6329 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:30.599 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:30.596+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:30.597673+0000) 2021-08-03T12:26:31.360 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:31.358+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:31.359033+0000) 2021-08-03T12:26:31.407 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:31.404+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:31.404905+0000) 2021-08-03T12:26:31.864 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:31.860+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:31.861574+0000) 2021-08-03T12:26:32.408 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:32.404+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:32.405509+0000) 2021-08-03T12:26:32.791 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:32.741+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6924 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:32.860 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:32.856+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:32.857169+0000) 2021-08-03T12:26:34.960 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:26:34.956+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:34.956732+0000) 2021-08-03T12:26:35.867 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:26:35.863+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:35.864042+0000) 2021-08-03T12:26:35.906 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:35.900+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:35.901704+0000) 2021-08-03T12:26:36.668 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:36.571+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6338 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:36.996 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:36.993+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:36.994511+0000) 2021-08-03T12:26:37.017 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:26:36.973+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:26:38.258 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:26:38.255+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:38.256854+0000) 2021-08-03T12:26:38.798 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:38.795+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:38.796415+0000) 2021-08-03T12:26:39.622 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:39.619+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:39.620521+0000) 2021-08-03T12:26:39.753 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:26:39.748+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:39.749482+0000) 2021-08-03T12:26:40.552 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:40.117+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6924 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:40.740 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:40.737+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:40.738167+0000) 2021-08-03T12:26:41.011 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:41.007+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:41.008100+0000) 2021-08-03T12:26:41.741 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:41.737+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:41.739258+0000) 2021-08-03T12:26:42.495 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:26:42.491+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:42.492364+0000) 2021-08-03T12:26:42.743 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:42.738+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:42.740247+0000) 2021-08-03T12:26:43.013 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:26:43.011+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:43.011942+0000) 2021-08-03T12:26:43.744 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:43.739+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:43.741456+0000) 2021-08-03T12:26:43.915 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:43.912+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6345 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:44.419 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:26:44.413+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:26:44.745 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:44.740+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:44.742584+0000) 2021-08-03T12:26:45.007 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:45.003+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:45.005738+0000) 2021-08-03T12:26:45.747 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:45.742+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:45.744213+0000) 2021-08-03T12:26:46.014 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:45.915+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6924 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:46.168 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:26:46.162+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:46.164660+0000) 2021-08-03T12:26:46.269 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:26:46.264+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:46.264941+0000) 2021-08-03T12:26:46.271 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:46.266+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:46.268283+0000) 2021-08-03T12:26:46.510 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:26:46.505+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:46.506793+0000) 2021-08-03T12:26:46.553 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:46.549+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:46.551307+0000) 2021-08-03T12:26:46.748 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:46.743+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:46.745512+0000) 2021-08-03T12:26:46.758 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:46.754+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:46.755058+0000) 2021-08-03T12:26:47.115 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:47.110+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:47.112793+0000) 2021-08-03T12:26:47.339 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:26:47.337+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:47.337956+0000) 2021-08-03T12:26:47.749 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:47.745+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:47.746796+0000) 2021-08-03T12:26:48.750 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:48.746+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:48.747820+0000) 2021-08-03T12:26:48.911 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:26:48.907+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:48.908440+0000) 2021-08-03T12:26:49.751 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:49.748+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:49.748799+0000) 2021-08-03T12:26:50.752 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:50.749+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:50.749834+0000) 2021-08-03T12:26:51.319 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:51.208+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6377 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:51.754 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:51.750+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:51.751119+0000) 2021-08-03T12:26:51.921 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:51.919+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:51.919842+0000) 2021-08-03T12:26:52.045 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:26:52.041+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:26:52.197 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:26:52.193+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:52.194519+0000) 2021-08-03T12:26:52.755 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:52.751+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:52.752025+0000) 2021-08-03T12:26:52.830 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:26:52.826+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:52.827122+0000) 2021-08-03T12:26:53.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:53.752+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:53.752959+0000) 2021-08-03T12:26:54.087 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:26:54.082+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:54.083286+0000) 2021-08-03T12:26:54.106 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:26:54.102+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:54.103592+0000) 2021-08-03T12:26:54.151 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:26:54.023+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6924 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:26:54.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:54.753+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:54.753932+0000) 2021-08-03T12:26:55.344 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:55.341+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:55.342715+0000) 2021-08-03T12:26:55.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:26:55.708+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:55.709192+0000) 2021-08-03T12:26:55.744 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:26:55.739+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:55.740643+0000) 2021-08-03T12:26:55.752 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:55.749+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:55.750491+0000) 2021-08-03T12:26:55.758 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:55.754+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:55.754945+0000) 2021-08-03T12:26:56.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:56.718+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:56.719120+0000) 2021-08-03T12:26:56.752 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:56.749+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:56.750636+0000) 2021-08-03T12:26:56.758 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:56.755+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:56.755929+0000) 2021-08-03T12:26:57.101 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:26:57.097+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:57.098004+0000) 2021-08-03T12:26:57.752 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:57.749+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:57.750779+0000) 2021-08-03T12:26:57.759 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:57.756+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:57.756839+0000) 2021-08-03T12:26:58.404 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:26:58.400+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6392 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:26:58.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:58.625+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:58.626002+0000) 2021-08-03T12:26:58.752 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:58.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:58.750896+0000) 2021-08-03T12:26:58.760 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:58.757+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:58.758090+0000) 2021-08-03T12:26:59.115 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:26:59.110+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:59.111097+0000) 2021-08-03T12:26:59.753 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:59.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:59.751032+0000) 2021-08-03T12:26:59.761 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:26:59.758+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:59.759367+0000) 2021-08-03T12:26:59.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:26:59.877+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:59.878318+0000) 2021-08-03T12:26:59.946 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:26:59.942+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:26:59.942965+0000) 2021-08-03T12:27:00.576 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:27:00.415+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:27:00.760 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:27:00.756+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:00.757064+0000) 2021-08-03T12:27:00.765 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:00.759+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:00.760375+0000) 2021-08-03T12:27:00.882 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:27:00.878+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:00.878940+0000) 2021-08-03T12:27:01.084 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:01.080+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:01.080977+0000) 2021-08-03T12:27:01.600 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:01.597+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:01.598015+0000) 2021-08-03T12:27:01.606 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:01.598+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6929 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:01.959 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:01.955+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:01.956451+0000) 2021-08-03T12:27:02.097 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:02.095+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:02.095828+0000) 2021-08-03T12:27:02.505 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:02.501+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:02.502072+0000) 2021-08-03T12:27:02.600 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:02.597+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:02.598128+0000) 2021-08-03T12:27:03.111 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:27:03.107+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:03.109560+0000) 2021-08-03T12:27:03.505 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:03.502+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:03.502786+0000) 2021-08-03T12:27:03.600 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:03.597+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:03.598283+0000) 2021-08-03T12:27:03.663 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:03.658+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:03.660128+0000) 2021-08-03T12:27:03.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:03.794+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:03.795421+0000) 2021-08-03T12:27:03.925 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:03.920+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:03.922163+0000) 2021-08-03T12:27:04.506 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:04.502+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:04.503574+0000) 2021-08-03T12:27:04.600 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:04.597+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:04.598429+0000) 2021-08-03T12:27:04.925 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:04.921+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:04.922865+0000) 2021-08-03T12:27:05.506 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:05.503+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:05.504200+0000) 2021-08-03T12:27:05.600 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:05.597+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:05.598567+0000) 2021-08-03T12:27:05.784 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:05.780+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:05.781022+0000) 2021-08-03T12:27:05.928 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:05.921+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:05.923435+0000) 2021-08-03T12:27:06.493 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:06.459+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6422 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:06.964 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:06.925+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6929 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:07.157 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:07.151+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:07.153527+0000) 2021-08-03T12:27:07.441 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:07.438+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:07.439401+0000) 2021-08-03T12:27:08.050 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:08.048+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:08.049075+0000) 2021-08-03T12:27:08.263 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:27:07.782+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:27:08.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:08.560+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:08.561406+0000) 2021-08-03T12:27:08.912 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:08.909+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:08.909753+0000) 2021-08-03T12:27:09.313 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:09.308+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:09.309049+0000) 2021-08-03T12:27:09.316 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:09.311+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:09.311867+0000) 2021-08-03T12:27:09.514 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:27:09.511+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:09.512638+0000) 2021-08-03T12:27:09.550 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:09.546+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:09.547641+0000) 2021-08-03T12:27:09.925 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:27:09.920+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:09.921052+0000) 2021-08-03T12:27:10.367 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:10.362+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:10.362798+0000) 2021-08-03T12:27:10.551 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:10.547+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:10.548408+0000) 2021-08-03T12:27:10.808 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:27:10.804+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:10.805294+0000) 2021-08-03T12:27:11.551 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:11.548+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:11.548985+0000) 2021-08-03T12:27:12.552 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:12.548+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:12.549599+0000) 2021-08-03T12:27:12.678 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:12.594+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6934 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:12.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:12.747+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:12.748151+0000) 2021-08-03T12:27:12.761 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:12.758+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:12.758746+0000) 2021-08-03T12:27:12.904 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:12.861+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6427 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:13.189 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:13.185+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:13.185799+0000) 2021-08-03T12:27:13.364 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:13.360+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:13.361237+0000) 2021-08-03T12:27:13.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:13.696+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:13.696994+0000) 2021-08-03T12:27:14.099 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:14.096+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:14.096752+0000) 2021-08-03T12:27:14.656 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:27:14.623+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:27:15.100 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:15.096+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:15.097437+0000) 2021-08-03T12:27:15.218 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:15.215+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:15.216694+0000) 2021-08-03T12:27:15.395 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:15.391+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:15.392640+0000) 2021-08-03T12:27:15.652 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:15.647+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:15.648783+0000) 2021-08-03T12:27:16.100 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:16.097+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:16.098008+0000) 2021-08-03T12:27:16.138 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:16.135+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:16.136179+0000) 2021-08-03T12:27:16.438 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:27:16.433+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:16.434528+0000) 2021-08-03T12:27:16.859 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:16.854+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:16.855284+0000) 2021-08-03T12:27:17.101 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:17.097+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:17.098574+0000) 2021-08-03T12:27:17.320 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:27:17.316+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:17.317056+0000) 2021-08-03T12:27:17.479 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:27:17.476+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:17.477523+0000) 2021-08-03T12:27:18.101 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:18.098+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:18.099145+0000) 2021-08-03T12:27:19.103 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:19.098+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:19.099704+0000) 2021-08-03T12:27:19.457 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:19.421+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6938 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:19.564 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:27:19.559+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:19.560622+0000) 2021-08-03T12:27:19.574 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:19.570+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6439 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:20.112 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:20.108+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:20.108884+0000) 2021-08-03T12:27:20.485 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:20.482+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:20.483658+0000) 2021-08-03T12:27:21.898 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:21.894+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:21.895156+0000) 2021-08-03T12:27:22.148 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:27:21.905+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:27:22.580 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:22.575+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:22.576125+0000) 2021-08-03T12:27:23.417 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:23.413+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:23.413927+0000) 2021-08-03T12:27:24.417 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:24.413+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:24.414691+0000) 2021-08-03T12:27:24.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:24.940+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:24.941074+0000) 2021-08-03T12:27:25.110 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:25.106+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:25.106963+0000) 2021-08-03T12:27:25.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:25.257+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:25.258176+0000) 2021-08-03T12:27:25.418 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:25.414+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:25.415519+0000) 2021-08-03T12:27:25.613 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:25.609+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6938 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:25.634 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:25.630+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:25.631233+0000) 2021-08-03T12:27:26.110 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:26.105+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:26.107676+0000) 2021-08-03T12:27:26.370 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:26.365+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:26.367582+0000) 2021-08-03T12:27:26.419 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:26.415+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:26.416359+0000) 2021-08-03T12:27:26.927 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:26.902+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6444 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:27.111 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:27.106+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:27.108260+0000) 2021-08-03T12:27:27.184 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:27:27.182+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:27.182913+0000) 2021-08-03T12:27:27.190 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:27.186+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:27.187764+0000) 2021-08-03T12:27:27.420 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:27.416+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:27.417193+0000) 2021-08-03T12:27:28.420 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:28.416+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:28.417779+0000) 2021-08-03T12:27:28.700 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:27:28.465+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:27:29.421 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:29.417+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:29.418422+0000) 2021-08-03T12:27:30.422 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:30.418+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:30.419256+0000) 2021-08-03T12:27:30.910 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:30.830+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6938 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:31.423 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:31.419+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:31.420140+0000) 2021-08-03T12:27:31.781 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:31.777+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:31.779597+0000) 2021-08-03T12:27:32.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:32.197+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:32.198870+0000) 2021-08-03T12:27:32.424 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:32.420+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:32.421214+0000) 2021-08-03T12:27:33.426 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:33.422+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:33.423107+0000) 2021-08-03T12:27:33.440 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:33.436+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:33.437543+0000) 2021-08-03T12:27:33.533 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:33.130+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6473 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:34.427 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:34.423+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:34.423898+0000) 2021-08-03T12:27:34.441 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:34.437+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:34.438492+0000) 2021-08-03T12:27:34.624 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:27:34.614+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:34.615145+0000) 2021-08-03T12:27:35.342 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:35.338+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:35.339381+0000) 2021-08-03T12:27:35.427 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:35.423+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:35.424494+0000) 2021-08-03T12:27:35.923 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:35.856+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6942 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:36.168 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:36.165+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:36.165994+0000) 2021-08-03T12:27:36.427 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:36.424+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:36.425095+0000) 2021-08-03T12:27:36.511 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:36.506+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:36.507613+0000) 2021-08-03T12:27:36.601 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:36.598+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:36.598986+0000) 2021-08-03T12:27:36.786 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:36.781+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:36.782442+0000) 2021-08-03T12:27:36.933 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:36.930+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:36.931184+0000) 2021-08-03T12:27:37.428 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:37.424+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:37.425701+0000) 2021-08-03T12:27:37.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:37.537+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:37.538066+0000) 2021-08-03T12:27:37.602 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:37.598+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:37.599140+0000) 2021-08-03T12:27:38.090 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:38.086+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:38.087186+0000) 2021-08-03T12:27:38.431 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:38.425+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:38.426319+0000) 2021-08-03T12:27:38.601 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:38.598+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:38.599295+0000) 2021-08-03T12:27:39.088 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:39.082+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6478 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:39.430 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:39.426+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:39.426984+0000) 2021-08-03T12:27:40.130 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:40.125+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:40.126549+0000) 2021-08-03T12:27:40.431 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:40.427+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:40.428104+0000) 2021-08-03T12:27:40.943 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:40.907+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6949 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:41.431 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:41.427+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:41.428729+0000) 2021-08-03T12:27:41.526 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:27:40.945+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:27:42.020 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:42.018+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:42.018816+0000) 2021-08-03T12:27:44.175 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:27:44.170+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:44.171565+0000) 2021-08-03T12:27:45.046 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:45.042+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:45.043016+0000) 2021-08-03T12:27:45.075 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:27:45.072+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:45.073259+0000) 2021-08-03T12:27:46.043 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:27:46.038+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:46.039728+0000) 2021-08-03T12:27:46.122 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:46.117+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6495 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:46.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:46.332+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:46.333308+0000) 2021-08-03T12:27:46.521 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:46.516+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:46.517135+0000) 2021-08-03T12:27:46.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:46.541+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:46.542106+0000) 2021-08-03T12:27:46.815 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:46.808+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:46.809563+0000) 2021-08-03T12:27:47.238 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:47.233+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:47.233807+0000) 2021-08-03T12:27:47.297 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:47.258+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6949 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:47.443 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:27:47.440+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:47.441782+0000) 2021-08-03T12:27:48.939 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:48.936+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:48.936826+0000) 2021-08-03T12:27:49.893 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:49.887+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:49.888315+0000) 2021-08-03T12:27:50.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:50.059+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:50.060221+0000) 2021-08-03T12:27:50.171 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:50.167+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:50.168068+0000) 2021-08-03T12:27:50.922 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:50.917+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:50.918469+0000) 2021-08-03T12:27:50.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:50.944+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:50.945029+0000) 2021-08-03T12:27:51.636 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:27:51.632+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:51.632861+0000) 2021-08-03T12:27:51.906 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:27:51.901+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:51.902223+0000) 2021-08-03T12:27:52.380 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:52.349+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6524 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:52.453 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:27:52.448+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:52.449639+0000) 2021-08-03T12:27:52.843 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:52.840+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:52.841373+0000) 2021-08-03T12:27:53.120 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:53.114+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:53.115791+0000) 2021-08-03T12:27:53.167 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:27:52.446+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3083 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:27:53.169 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:27:53.166+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:53.167788+0000) 2021-08-03T12:27:53.750 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:27:53.744+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:53.745739+0000) 2021-08-03T12:27:54.179 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:54.159+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6959 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:54.827 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:54.824+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:54.824961+0000) 2021-08-03T12:27:56.150 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:27:56.144+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:56.145325+0000) 2021-08-03T12:27:56.661 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:56.656+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:56.657544+0000) 2021-08-03T12:27:56.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:56.718+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:56.719643+0000) 2021-08-03T12:27:57.425 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:27:57.420+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:57.421743+0000) 2021-08-03T12:27:57.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:57.566+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:57.567458+0000) 2021-08-03T12:27:57.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:57.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:57.723907+0000) 2021-08-03T12:27:58.114 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:58.110+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:58.111634+0000) 2021-08-03T12:27:58.391 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:27:58.387+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:58.388017+0000) 2021-08-03T12:27:58.679 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:27:58.584+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6535 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:27:59.014 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:59.011+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:59.012285+0000) 2021-08-03T12:27:59.115 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:27:59.111+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:59.112359+0000) 2021-08-03T12:27:59.264 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:27:59.261+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:59.261915+0000) 2021-08-03T12:27:59.469 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:27:59.245+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6959 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:27:59.803 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:27:59.799+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:27:59.799823+0000) 2021-08-03T12:28:00.116 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:00.112+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:00.112905+0000) 2021-08-03T12:28:00.669 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:00.666+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:00.667540+0000) 2021-08-03T12:28:00.753 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:00.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:00.751622+0000) 2021-08-03T12:28:01.111 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:01.107+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3084 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:28:01.116 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:01.112+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:01.113473+0000) 2021-08-03T12:28:01.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:01.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:01.751781+0000) 2021-08-03T12:28:02.117 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:02.113+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:02.114480+0000) 2021-08-03T12:28:02.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:02.359+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:02.359854+0000) 2021-08-03T12:28:02.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:02.483+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:02.484267+0000) 2021-08-03T12:28:02.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:02.751+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:02.751920+0000) 2021-08-03T12:28:03.118 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:03.114+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:03.115057+0000) 2021-08-03T12:28:03.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:03.359+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:03.360023+0000) 2021-08-03T12:28:03.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:03.751+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:03.752064+0000) 2021-08-03T12:28:04.118 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:04.114+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:04.115597+0000) 2021-08-03T12:28:04.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:04.359+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:04.360141+0000) 2021-08-03T12:28:04.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:04.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:04.752186+0000) 2021-08-03T12:28:05.119 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:05.114+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:05.116321+0000) 2021-08-03T12:28:05.288 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:05.283+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:05.284908+0000) 2021-08-03T12:28:05.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:05.358+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:05.360280+0000) 2021-08-03T12:28:05.484 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:05.478+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:05.480215+0000) 2021-08-03T12:28:05.690 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:05.482+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6959 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:05.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:05.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:05.752317+0000) 2021-08-03T12:28:05.898 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:05.893+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:05.895378+0000) 2021-08-03T12:28:06.119 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:06.115+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:06.116902+0000) 2021-08-03T12:28:06.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:06.358+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:06.360438+0000) 2021-08-03T12:28:06.629 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:06.623+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:06.625179+0000) 2021-08-03T12:28:06.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:06.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:06.752469+0000) 2021-08-03T12:28:07.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:07.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:07.752622+0000) 2021-08-03T12:28:07.940 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:07.935+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:07.937271+0000) 2021-08-03T12:28:08.167 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:08.162+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:08.164260+0000) 2021-08-03T12:28:08.168 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:07.790+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:28:08.713 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:08.708+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6550 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:08.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:08.750+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:08.752727+0000) 2021-08-03T12:28:08.784 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:08.778+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:08.780385+0000) 2021-08-03T12:28:08.940 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:08.936+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:08.937985+0000) 2021-08-03T12:28:09.168 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:09.163+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:09.164957+0000) 2021-08-03T12:28:09.482 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:09.478+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:09.479880+0000) 2021-08-03T12:28:09.784 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:09.779+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:09.781051+0000) 2021-08-03T12:28:10.168 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:10.163+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:10.165560+0000) 2021-08-03T12:28:10.527 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:10.521+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:10.523647+0000) 2021-08-03T12:28:10.784 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:10.779+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:10.781668+0000) 2021-08-03T12:28:11.032 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:28:11.028+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:11.029084+0000) 2021-08-03T12:28:11.170 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:11.164+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:11.166190+0000) 2021-08-03T12:28:11.201 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:11.196+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:11.197765+0000) 2021-08-03T12:28:11.785 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:11.780+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:11.782408+0000) 2021-08-03T12:28:12.012 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:12.008+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:12.009944+0000) 2021-08-03T12:28:12.088 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:12.082+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6959 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:12.170 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:12.165+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:12.166809+0000) 2021-08-03T12:28:12.539 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:12.536+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:12.537776+0000) 2021-08-03T12:28:12.607 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:12.602+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:12.604701+0000) 2021-08-03T12:28:12.786 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:12.782+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:12.782910+0000) 2021-08-03T12:28:13.786 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:13.782+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:13.783448+0000) 2021-08-03T12:28:13.821 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:13.816+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:13.817472+0000) 2021-08-03T12:28:14.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:14.012+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:14.013202+0000) 2021-08-03T12:28:14.019 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:14.016+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:14.017100+0000) 2021-08-03T12:28:14.087 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:14.021+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6552 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:14.510 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:14.505+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:14.506115+0000) 2021-08-03T12:28:14.532 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:28:14.527+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:14.528419+0000) 2021-08-03T12:28:15.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:15.012+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:15.013361+0000) 2021-08-03T12:28:15.017 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:14.996+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:28:15.173 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:15.170+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:15.171265+0000) 2021-08-03T12:28:15.459 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:15.454+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:15.455088+0000) 2021-08-03T12:28:16.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:16.012+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:16.013493+0000) 2021-08-03T12:28:16.711 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:16.707+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:16.707884+0000) 2021-08-03T12:28:16.859 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:16.854+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:16.855689+0000) 2021-08-03T12:28:17.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:17.012+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:17.013633+0000) 2021-08-03T12:28:18.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:18.012+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:18.013773+0000) 2021-08-03T12:28:18.419 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:18.414+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:18.415636+0000) 2021-08-03T12:28:19.016 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:19.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:19.013918+0000) 2021-08-03T12:28:19.658 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:19.655+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:19.656165+0000) 2021-08-03T12:28:19.689 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:19.685+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6960 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:19.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:19.707+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:19.708556+0000) 2021-08-03T12:28:20.016 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:20.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:20.014042+0000) 2021-08-03T12:28:20.494 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:20.488+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:20.489650+0000) 2021-08-03T12:28:20.736 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:20.732+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:20.732721+0000) 2021-08-03T12:28:21.016 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:21.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:21.014145+0000) 2021-08-03T12:28:21.120 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:21.079+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6560 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:22.016 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:22.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:22.014296+0000) 2021-08-03T12:28:23.016 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:23.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:23.014434+0000) 2021-08-03T12:28:23.651 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:23.648+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:23.649047+0000) 2021-08-03T12:28:24.016 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:24.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:24.014564+0000) 2021-08-03T12:28:24.556 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:24.551+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:24.552479+0000) 2021-08-03T12:28:25.017 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:25.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:25.014714+0000) 2021-08-03T12:28:25.203 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:25.199+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:25.199914+0000) 2021-08-03T12:28:26.017 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:26.013+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:26.014852+0000) 2021-08-03T12:28:26.515 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:26.512+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:26.513607+0000) 2021-08-03T12:28:27.016 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:27.014+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:27.014981+0000) 2021-08-03T12:28:27.065 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:27.009+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6965 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:27.072 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:27.069+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:28:27.590 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:28:27.584+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:27.585595+0000) 2021-08-03T12:28:27.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:27.753+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:27.754301+0000) 2021-08-03T12:28:27.897 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:27.893+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:27.894195+0000) 2021-08-03T12:28:28.017 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:28.014+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:28.015138+0000) 2021-08-03T12:28:28.251 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:28.174+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6591 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:28.315 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:28.310+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:28.311497+0000) 2021-08-03T12:28:28.389 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:28.384+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:28.385697+0000) 2021-08-03T12:28:28.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:28.725+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:28.725912+0000) 2021-08-03T12:28:28.994 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:28.991+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:28.992115+0000) 2021-08-03T12:28:29.054 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:29.049+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:29.050736+0000) 2021-08-03T12:28:29.076 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:29.072+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:29.073230+0000) 2021-08-03T12:28:29.546 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:29.542+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:29.542780+0000) 2021-08-03T12:28:30.077 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:30.073+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:30.073956+0000) 2021-08-03T12:28:30.993 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:30.990+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:30.991533+0000) 2021-08-03T12:28:31.078 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:31.073+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:31.074526+0000) 2021-08-03T12:28:32.078 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:32.074+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:32.075166+0000) 2021-08-03T12:28:32.440 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:32.437+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:32.437875+0000) 2021-08-03T12:28:33.079 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:33.075+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:33.075805+0000) 2021-08-03T12:28:33.143 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:33.138+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6965 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:33.277 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:33.274+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:33.275624+0000) 2021-08-03T12:28:33.322 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:33.317+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:33.318187+0000) 2021-08-03T12:28:33.441 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:33.437+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:33.438598+0000) 2021-08-03T12:28:33.574 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:33.570+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:28:34.080 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:34.075+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:34.076412+0000) 2021-08-03T12:28:34.442 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:34.438+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:34.438999+0000) 2021-08-03T12:28:34.723 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:28:34.719+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:34.720024+0000) 2021-08-03T12:28:34.743 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:34.723+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6621 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:34.790 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:34.786+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:34.786748+0000) 2021-08-03T12:28:35.084 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:35.077+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:35.077989+0000) 2021-08-03T12:28:35.376 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:35.371+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:35.372184+0000) 2021-08-03T12:28:35.442 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:35.438+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:35.439597+0000) 2021-08-03T12:28:36.081 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:36.077+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:36.078630+0000) 2021-08-03T12:28:36.443 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:36.439+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:36.440407+0000) 2021-08-03T12:28:36.765 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:36.761+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:36.762334+0000) 2021-08-03T12:28:37.082 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:37.078+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:37.079614+0000) 2021-08-03T12:28:37.254 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:37.251+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:37.252319+0000) 2021-08-03T12:28:37.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:37.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:37.360838+0000) 2021-08-03T12:28:37.444 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:37.440+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:37.440998+0000) 2021-08-03T12:28:37.517 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:37.513+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:37.514455+0000) 2021-08-03T12:28:38.083 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:38.079+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:38.080428+0000) 2021-08-03T12:28:38.322 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:38.319+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:38.320291+0000) 2021-08-03T12:28:38.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:38.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:38.360973+0000) 2021-08-03T12:28:38.444 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:38.440+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:38.441584+0000) 2021-08-03T12:28:38.518 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:38.514+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:38.515106+0000) 2021-08-03T12:28:39.084 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:39.080+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.081013+0000) 2021-08-03T12:28:39.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:39.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.361104+0000) 2021-08-03T12:28:39.366 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:39.362+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.363187+0000) 2021-08-03T12:28:39.420 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:39.399+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6973 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:39.443 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:39.438+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.439594+0000) 2021-08-03T12:28:39.445 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:39.441+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.442439+0000) 2021-08-03T12:28:39.518 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:39.514+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.515686+0000) 2021-08-03T12:28:39.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:39.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.753106+0000) 2021-08-03T12:28:39.945 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:39.941+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:39.942118+0000) 2021-08-03T12:28:40.084 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:40.080+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:40.081743+0000) 2021-08-03T12:28:40.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:40.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:40.361227+0000) 2021-08-03T12:28:40.446 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:40.442+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:40.443567+0000) 2021-08-03T12:28:40.519 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:40.515+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:40.516305+0000) 2021-08-03T12:28:40.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:40.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:40.753252+0000) 2021-08-03T12:28:40.946 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:40.942+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:40.943126+0000) 2021-08-03T12:28:41.085 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:41.081+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:41.082319+0000) 2021-08-03T12:28:41.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:41.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:41.361374+0000) 2021-08-03T12:28:41.447 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:41.443+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:41.444550+0000) 2021-08-03T12:28:41.519 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:41.516+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:41.516863+0000) 2021-08-03T12:28:41.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:41.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:41.753402+0000) 2021-08-03T12:28:41.847 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:41.796+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6626 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:41.946 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:41.942+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:41.943726+0000) 2021-08-03T12:28:42.086 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:42.082+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:42.082894+0000) 2021-08-03T12:28:42.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:42.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:42.361535+0000) 2021-08-03T12:28:42.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:42.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:42.753516+0000) 2021-08-03T12:28:42.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:42.815+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:42.816102+0000) 2021-08-03T12:28:42.947 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:42.943+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:42.944335+0000) 2021-08-03T12:28:43.086 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:43.082+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:43.083511+0000) 2021-08-03T12:28:43.183 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:43.180+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:43.181538+0000) 2021-08-03T12:28:43.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:43.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:43.361639+0000) 2021-08-03T12:28:43.565 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:28:43.560+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:43.561441+0000) 2021-08-03T12:28:43.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:43.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:43.753673+0000) 2021-08-03T12:28:43.947 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:43.944+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:43.944919+0000) 2021-08-03T12:28:44.087 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:44.083+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.084120+0000) 2021-08-03T12:28:44.167 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:44.162+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.163157+0000) 2021-08-03T12:28:44.261 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:44.257+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.258241+0000) 2021-08-03T12:28:44.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:44.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.361753+0000) 2021-08-03T12:28:44.369 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:43.896+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:28:44.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:44.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.753803+0000) 2021-08-03T12:28:44.853 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:44.849+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.850124+0000) 2021-08-03T12:28:44.910 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:44.906+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.907273+0000) 2021-08-03T12:28:44.948 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:44.944+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:44.945526+0000) 2021-08-03T12:28:45.087 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:45.084+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:45.084925+0000) 2021-08-03T12:28:45.170 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:45.167+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:45.168242+0000) 2021-08-03T12:28:45.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:45.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:45.361911+0000) 2021-08-03T12:28:45.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:45.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:45.753927+0000) 2021-08-03T12:28:45.923 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:28:45.919+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:45.920133+0000) 2021-08-03T12:28:45.948 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:45.945+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:45.946119+0000) 2021-08-03T12:28:45.983 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:45.976+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6990 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:46.088 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:46.084+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:46.085500+0000) 2021-08-03T12:28:46.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:46.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:46.362021+0000) 2021-08-03T12:28:46.609 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:28:46.604+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:46.605298+0000) 2021-08-03T12:28:46.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:46.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:46.754080+0000) 2021-08-03T12:28:46.950 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:46.945+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:46.946721+0000) 2021-08-03T12:28:47.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:47.049+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:47.049876+0000) 2021-08-03T12:28:47.089 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:47.085+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:47.086310+0000) 2021-08-03T12:28:47.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:47.229+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:47.230146+0000) 2021-08-03T12:28:47.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:47.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:47.362158+0000) 2021-08-03T12:28:47.496 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:28:47.491+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:47.492564+0000) 2021-08-03T12:28:47.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:47.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:47.754217+0000) 2021-08-03T12:28:47.950 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:47.946+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:47.947404+0000) 2021-08-03T12:28:48.089 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:48.086+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:48.086916+0000) 2021-08-03T12:28:48.096 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:48.007+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6652 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:48.288 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:28:48.283+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:48.284501+0000) 2021-08-03T12:28:48.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:48.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:48.362323+0000) 2021-08-03T12:28:48.441 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:48.436+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:48.436884+0000) 2021-08-03T12:28:48.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:48.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:48.754373+0000) 2021-08-03T12:28:48.951 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:48.947+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:48.948074+0000) 2021-08-03T12:28:49.017 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:49.014+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:49.015575+0000) 2021-08-03T12:28:49.090 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:49.086+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:49.087493+0000) 2021-08-03T12:28:49.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:49.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:49.362431+0000) 2021-08-03T12:28:49.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:49.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:49.754508+0000) 2021-08-03T12:28:49.952 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:49.948+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:49.948909+0000) 2021-08-03T12:28:50.091 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:50.087+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:50.088202+0000) 2021-08-03T12:28:50.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:50.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:50.362579+0000) 2021-08-03T12:28:50.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:50.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:50.754649+0000) 2021-08-03T12:28:50.952 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:50.949+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:50.949918+0000) 2021-08-03T12:28:51.092 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:51.088+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:51.089121+0000) 2021-08-03T12:28:51.217 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:51.212+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:51.213764+0000) 2021-08-03T12:28:51.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:51.360+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:51.362704+0000) 2021-08-03T12:28:51.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:51.752+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:51.754799+0000) 2021-08-03T12:28:51.760 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:51.575+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:28:51.953 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:51.949+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:51.950542+0000) 2021-08-03T12:28:52.093 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:52.088+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:52.089718+0000) 2021-08-03T12:28:52.096 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:52.093+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:52.094831+0000) 2021-08-03T12:28:52.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:52.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:52.362860+0000) 2021-08-03T12:28:52.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:52.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:52.754942+0000) 2021-08-03T12:28:52.954 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:52.950+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:52.951379+0000) 2021-08-03T12:28:53.093 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:53.089+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:53.090371+0000) 2021-08-03T12:28:53.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:53.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:53.363002+0000) 2021-08-03T12:28:53.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:53.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:53.755069+0000) 2021-08-03T12:28:53.954 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:53.951+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:53.951952+0000) 2021-08-03T12:28:54.041 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:53.730+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6996 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:28:54.049 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:28:54.045+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6660 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:28:54.094 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:54.090+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:54.091177+0000) 2021-08-03T12:28:54.213 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:28:54.208+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:54.209713+0000) 2021-08-03T12:28:54.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:54.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:54.363146+0000) 2021-08-03T12:28:54.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:54.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:54.755245+0000) 2021-08-03T12:28:54.956 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:54.952+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:54.952881+0000) 2021-08-03T12:28:55.095 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:55.090+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:55.091788+0000) 2021-08-03T12:28:55.202 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:28:55.199+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:55.200335+0000) 2021-08-03T12:28:55.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:55.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:55.363297+0000) 2021-08-03T12:28:55.373 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:55.369+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:55.370880+0000) 2021-08-03T12:28:55.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:55.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:55.755391+0000) 2021-08-03T12:28:55.956 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:55.952+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:55.953484+0000) 2021-08-03T12:28:56.095 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:56.091+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:56.092439+0000) 2021-08-03T12:28:56.329 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:28:56.323+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:56.324937+0000) 2021-08-03T12:28:56.333 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:56.329+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:56.331289+0000) 2021-08-03T12:28:56.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:56.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:56.363430+0000) 2021-08-03T12:28:56.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:56.753+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:56.755545+0000) 2021-08-03T12:28:56.957 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:56.953+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:56.954151+0000) 2021-08-03T12:28:57.096 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:57.092+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:57.093296+0000) 2021-08-03T12:28:57.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:57.361+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:57.363570+0000) 2021-08-03T12:28:57.498 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:28:57.494+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:57.494943+0000) 2021-08-03T12:28:57.758 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:57.754+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:57.755701+0000) 2021-08-03T12:28:57.957 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:57.953+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:57.954750+0000) 2021-08-03T12:28:58.097 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:58.093+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:58.094422+0000) 2021-08-03T12:28:58.758 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:58.755+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:58.755866+0000) 2021-08-03T12:28:58.958 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:58.954+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:58.955483+0000) 2021-08-03T12:28:59.102 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:59.094+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:59.095290+0000) 2021-08-03T12:28:59.374 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:28:59.369+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:59.370358+0000) 2021-08-03T12:28:59.730 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:59.727+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:59.728451+0000) 2021-08-03T12:28:59.758 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:28:59.755+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:59.755977+0000) 2021-08-03T12:28:59.963 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:28:59.955+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:28:59.956114+0000) 2021-08-03T12:28:59.974 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:28:59.971+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6998 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:00.275 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:00.270+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:00.271300+0000) 2021-08-03T12:29:00.411 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:28:59.645+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:00.690 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:00.549+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6687 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:00.733 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:00.730+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:00.731159+0000) 2021-08-03T12:29:00.804 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:00.800+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:00.801294+0000) 2021-08-03T12:29:01.735 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:01.732+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:01.733022+0000) 2021-08-03T12:29:01.762 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:01.758+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:01.759328+0000) 2021-08-03T12:29:02.968 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:29:02.964+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:02.965719+0000) 2021-08-03T12:29:02.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:02.969+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:02.970548+0000) 2021-08-03T12:29:05.049 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:05.042+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:05.044674+0000) 2021-08-03T12:29:05.541 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:05.537+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:05.538293+0000) 2021-08-03T12:29:06.251 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:29:06.063+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:06.543 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:06.537+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:06.539612+0000) 2021-08-03T12:29:06.723 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:06.602+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 6998 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:07.126 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:07.122+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:07.122970+0000) 2021-08-03T12:29:07.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:07.637+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:07.638320+0000) 2021-08-03T12:29:07.902 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:07.706+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6716 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:08.614 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:08.608+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:08.608780+0000) 2021-08-03T12:29:09.120 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:09.115+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:09.116271+0000) 2021-08-03T12:29:09.602 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:09.599+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:09.600156+0000) 2021-08-03T12:29:10.564 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:10.558+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:10.560377+0000) 2021-08-03T12:29:10.602 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:10.599+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:10.600309+0000) 2021-08-03T12:29:11.602 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:11.599+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:11.600466+0000) 2021-08-03T12:29:11.918 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:11.913+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:11.914627+0000) 2021-08-03T12:29:11.939 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:11.936+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:11.937442+0000) 2021-08-03T12:29:11.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:11.942+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:11.942966+0000) 2021-08-03T12:29:12.307 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:12.304+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:12.305275+0000) 2021-08-03T12:29:12.452 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:12.449+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:12.449956+0000) 2021-08-03T12:29:12.523 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:12.519+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:12.520334+0000) 2021-08-03T12:29:12.603 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:12.599+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:12.600621+0000) 2021-08-03T12:29:13.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:13.088+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:13.089597+0000) 2021-08-03T12:29:13.178 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:13.174+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:13.174871+0000) 2021-08-03T12:29:13.297 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:13.293+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:13.293917+0000) 2021-08-03T12:29:13.453 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:13.449+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:13.450565+0000) 2021-08-03T12:29:13.524 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:13.520+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:13.521028+0000) 2021-08-03T12:29:13.603 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:13.599+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:13.600777+0000) 2021-08-03T12:29:14.071 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:29:13.767+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:14.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:14.088+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:14.089727+0000) 2021-08-03T12:29:14.156 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:14.151+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6723 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:14.307 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:14.058+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7012 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:14.454 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:14.450+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:14.451155+0000) 2021-08-03T12:29:14.524 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:14.520+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:14.521588+0000) 2021-08-03T12:29:14.570 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:14.567+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:14.567797+0000) 2021-08-03T12:29:14.603 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:14.600+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:14.600939+0000) 2021-08-03T12:29:15.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:15.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:15.089878+0000) 2021-08-03T12:29:15.221 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:15.216+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:15.217006+0000) 2021-08-03T12:29:15.455 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:15.451+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:15.451801+0000) 2021-08-03T12:29:15.525 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:15.521+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:15.522143+0000) 2021-08-03T12:29:15.603 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:15.600+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:15.601068+0000) 2021-08-03T12:29:15.615 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:15.610+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:15.611534+0000) 2021-08-03T12:29:15.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:29:15.948+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:15.949629+0000) 2021-08-03T12:29:16.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:16.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:16.090027+0000) 2021-08-03T12:29:16.456 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:16.452+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:16.452937+0000) 2021-08-03T12:29:17.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:17.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:17.090178+0000) 2021-08-03T12:29:17.457 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:17.453+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:17.453990+0000) 2021-08-03T12:29:18.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:18.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:18.090312+0000) 2021-08-03T12:29:18.124 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:18.120+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:18.120855+0000) 2021-08-03T12:29:18.126 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:18.122+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:18.122741+0000) 2021-08-03T12:29:18.129 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:18.124+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:18.125513+0000) 2021-08-03T12:29:18.457 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:18.453+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:18.454626+0000) 2021-08-03T12:29:18.671 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:18.666+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:18.667397+0000) 2021-08-03T12:29:19.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:19.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:19.090474+0000) 2021-08-03T12:29:19.127 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:19.122+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:19.123654+0000) 2021-08-03T12:29:19.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:19.223+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:19.224299+0000) 2021-08-03T12:29:19.458 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:19.454+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:19.455441+0000) 2021-08-03T12:29:20.063 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:20.059+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7021 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:20.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:20.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:20.090606+0000) 2021-08-03T12:29:20.296 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:29:20.240+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:20.459 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:20.455+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:20.456109+0000) 2021-08-03T12:29:20.561 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:20.558+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:20.558996+0000) 2021-08-03T12:29:20.821 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:20.816+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6751 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:20.904 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:20.901+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:20.902596+0000) 2021-08-03T12:29:21.093 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:21.089+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:21.090723+0000) 2021-08-03T12:29:21.970 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:21.965+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:21.965937+0000) 2021-08-03T12:29:22.735 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:22.731+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:22.732386+0000) 2021-08-03T12:29:23.157 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:29:23.153+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:23.154787+0000) 2021-08-03T12:29:24.205 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:24.200+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:24.201382+0000) 2021-08-03T12:29:24.569 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:24.564+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:24.565113+0000) 2021-08-03T12:29:24.634 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:24.628+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:24.629587+0000) 2021-08-03T12:29:24.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:24.632+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:24.633043+0000) 2021-08-03T12:29:24.648 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:24.644+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:24.644946+0000) 2021-08-03T12:29:25.502 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:25.497+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:25.498365+0000) 2021-08-03T12:29:25.724 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:25.719+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:25.720422+0000) 2021-08-03T12:29:25.803 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:25.799+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:25.800205+0000) 2021-08-03T12:29:25.889 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:29:25.664+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:26.351 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:26.348+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:26.349271+0000) 2021-08-03T12:29:26.571 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:26.550+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7021 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:26.804 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:26.800+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:26.800893+0000) 2021-08-03T12:29:27.093 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:27.089+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:27.089962+0000) 2021-08-03T12:29:27.116 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:27.111+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:27.112709+0000) 2021-08-03T12:29:27.533 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:27.525+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6775 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:27.634 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:27.630+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:27.630968+0000) 2021-08-03T12:29:27.804 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:27.800+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:27.801485+0000) 2021-08-03T12:29:27.997 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:27.994+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:27.995209+0000) 2021-08-03T12:29:28.143 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:28.139+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:28.140169+0000) 2021-08-03T12:29:28.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:28.606+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:28.607763+0000) 2021-08-03T12:29:28.766 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:28.761+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:28.762468+0000) 2021-08-03T12:29:28.805 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:28.801+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:28.802288+0000) 2021-08-03T12:29:29.481 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:29.476+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:29.477179+0000) 2021-08-03T12:29:29.519 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:29.515+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:29.515923+0000) 2021-08-03T12:29:29.806 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:29.802+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:29.802906+0000) 2021-08-03T12:29:30.220 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:30.214+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:30.215172+0000) 2021-08-03T12:29:30.559 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:30.554+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:30.555463+0000) 2021-08-03T12:29:30.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:30.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:30.697424+0000) 2021-08-03T12:29:30.807 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:30.803+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:30.803796+0000) 2021-08-03T12:29:31.484 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:29:31.263+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:31.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:31.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:31.697554+0000) 2021-08-03T12:29:31.807 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:31.803+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:31.804354+0000) 2021-08-03T12:29:32.318 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:29:32.315+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:32.316496+0000) 2021-08-03T12:29:32.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:32.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:32.697707+0000) 2021-08-03T12:29:32.719 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:32.658+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7021 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:32.735 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:32.732+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:32.733430+0000) 2021-08-03T12:29:32.808 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:32.804+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:32.804912+0000) 2021-08-03T12:29:32.937 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:32.931+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:32.931933+0000) 2021-08-03T12:29:33.073 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:33.067+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:33.067843+0000) 2021-08-03T12:29:33.362 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:33.357+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:33.358148+0000) 2021-08-03T12:29:33.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:33.697+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:33.697864+0000) 2021-08-03T12:29:33.742 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:33.701+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6783 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:33.808 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:33.804+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:33.805515+0000) 2021-08-03T12:29:34.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:34.652+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:34.653834+0000) 2021-08-03T12:29:34.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:34.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:34.698003+0000) 2021-08-03T12:29:34.809 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:34.804+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:34.806500+0000) 2021-08-03T12:29:35.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:35.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:35.698137+0000) 2021-08-03T12:29:35.810 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:35.805+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:35.807268+0000) 2021-08-03T12:29:35.980 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:35.974+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:35.976166+0000) 2021-08-03T12:29:36.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:36.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:36.698289+0000) 2021-08-03T12:29:36.811 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:36.806+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:36.807960+0000) 2021-08-03T12:29:37.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:37.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:37.698401+0000) 2021-08-03T12:29:37.811 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:37.806+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:37.808507+0000) 2021-08-03T12:29:37.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:37.877+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:37.879670+0000) 2021-08-03T12:29:38.129 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:38.124+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:38.126627+0000) 2021-08-03T12:29:38.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:38.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:38.698537+0000) 2021-08-03T12:29:38.812 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:38.807+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:38.809205+0000) 2021-08-03T12:29:39.131 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:39.126+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:39.127913+0000) 2021-08-03T12:29:39.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:39.696+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:39.698688+0000) 2021-08-03T12:29:39.813 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:39.808+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:39.809806+0000) 2021-08-03T12:29:39.942 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:39.865+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7021 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:40.089 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:40.026+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6792 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:40.131 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:40.126+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:40.128536+0000) 2021-08-03T12:29:40.583 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:29:40.580+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:40.581201+0000) 2021-08-03T12:29:40.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:40.697+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:40.698811+0000) 2021-08-03T12:29:40.813 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:40.808+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:40.810401+0000) 2021-08-03T12:29:41.134 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:41.127+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:41.129122+0000) 2021-08-03T12:29:41.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:41.450+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:41.452520+0000) 2021-08-03T12:29:41.545 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:41.539+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:41.540289+0000) 2021-08-03T12:29:41.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:41.697+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:41.698982+0000) 2021-08-03T12:29:41.814 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:41.809+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:41.811189+0000) 2021-08-03T12:29:41.971 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:41.967+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:41.968699+0000) 2021-08-03T12:29:42.132 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:42.127+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:42.129690+0000) 2021-08-03T12:29:42.278 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:42.273+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:42.274319+0000) 2021-08-03T12:29:42.472 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:42.467+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:42.468542+0000) 2021-08-03T12:29:42.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:42.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:42.699107+0000) 2021-08-03T12:29:42.815 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:42.811+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:42.811963+0000) 2021-08-03T12:29:42.972 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:42.969+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:42.969791+0000) 2021-08-03T12:29:43.133 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:43.129+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:43.130265+0000) 2021-08-03T12:29:43.570 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:43.565+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:43.566269+0000) 2021-08-03T12:29:43.686 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:43.681+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:43.682470+0000) 2021-08-03T12:29:43.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:43.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:43.699236+0000) 2021-08-03T12:29:43.816 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:43.812+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:43.812760+0000) 2021-08-03T12:29:43.872 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:43.869+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:43.870720+0000) 2021-08-03T12:29:43.973 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:43.969+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:43.970383+0000) 2021-08-03T12:29:44.133 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:44.130+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:44.130836+0000) 2021-08-03T12:29:44.182 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:44.178+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:44.179361+0000) 2021-08-03T12:29:44.470 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:29:44.243+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:44.496 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:44.491+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:44.492289+0000) 2021-08-03T12:29:44.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:44.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:44.699370+0000) 2021-08-03T12:29:44.816 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:44.812+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:44.813625+0000) 2021-08-03T12:29:44.974 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:44.970+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:44.970995+0000) 2021-08-03T12:29:45.134 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:45.130+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:45.131433+0000) 2021-08-03T12:29:45.183 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:45.179+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:45.180091+0000) 2021-08-03T12:29:45.575 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:45.571+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:45.571916+0000) 2021-08-03T12:29:45.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:45.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:45.699506+0000) 2021-08-03T12:29:45.817 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:45.813+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:45.814035+0000) 2021-08-03T12:29:45.975 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:45.971+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:45.971849+0000) 2021-08-03T12:29:46.135 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:46.131+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.132055+0000) 2021-08-03T12:29:46.184 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:46.180+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.180857+0000) 2021-08-03T12:29:46.531 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:46.527+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.528055+0000) 2021-08-03T12:29:46.576 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:46.572+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.573205+0000) 2021-08-03T12:29:46.603 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:46.600+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.601521+0000) 2021-08-03T12:29:46.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:46.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.699622+0000) 2021-08-03T12:29:46.817 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:46.814+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.814754+0000) 2021-08-03T12:29:46.975 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:46.971+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:46.972660+0000) 2021-08-03T12:29:47.135 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:47.131+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.132624+0000) 2021-08-03T12:29:47.184 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:47.180+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.181411+0000) 2021-08-03T12:29:47.368 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:47.210+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7021 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:47.531 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:47.528+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.528737+0000) 2021-08-03T12:29:47.580 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:47.558+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6837 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:47.603 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:47.600+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.601654+0000) 2021-08-03T12:29:47.646 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:47.642+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.642808+0000) 2021-08-03T12:29:47.654 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:47.650+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.650972+0000) 2021-08-03T12:29:47.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:47.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.699741+0000) 2021-08-03T12:29:47.818 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:47.814+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.815333+0000) 2021-08-03T12:29:47.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:47.972+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:47.973242+0000) 2021-08-03T12:29:48.136 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:48.132+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:48.133452+0000) 2021-08-03T12:29:48.185 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:48.181+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:48.182032+0000) 2021-08-03T12:29:48.532 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:48.528+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:48.529353+0000) 2021-08-03T12:29:48.604 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:48.600+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:48.601787+0000) 2021-08-03T12:29:48.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:48.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:48.699852+0000) 2021-08-03T12:29:48.819 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:48.815+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:48.815916+0000) 2021-08-03T12:29:48.976 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:48.972+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:48.973714+0000) 2021-08-03T12:29:49.137 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:49.133+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.134272+0000) 2021-08-03T12:29:49.189 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:49.185+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.186269+0000) 2021-08-03T12:29:49.604 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:49.601+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.601936+0000) 2021-08-03T12:29:49.645 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:29:49.642+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.643421+0000) 2021-08-03T12:29:49.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:49.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.699965+0000) 2021-08-03T12:29:49.879 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:49.874+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.875347+0000) 2021-08-03T12:29:49.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:49.973+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.974280+0000) 2021-08-03T12:29:49.978 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:49.974+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:49.975656+0000) 2021-08-03T12:29:50.037 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:50.034+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:50.035172+0000) 2021-08-03T12:29:50.138 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:50.134+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:50.134870+0000) 2021-08-03T12:29:50.190 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:50.186+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:50.187266+0000) 2021-08-03T12:29:50.604 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:50.601+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:50.602072+0000) 2021-08-03T12:29:50.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:50.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:50.700096+0000) 2021-08-03T12:29:50.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:50.974+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:50.974866+0000) 2021-08-03T12:29:51.059 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:51.054+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.055092+0000) 2021-08-03T12:29:51.138 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:51.134+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.135662+0000) 2021-08-03T12:29:51.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:51.187+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.187891+0000) 2021-08-03T12:29:51.250 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:29:51.136+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:29:51.465 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:51.461+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.461902+0000) 2021-08-03T12:29:51.604 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:51.601+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.602177+0000) 2021-08-03T12:29:51.655 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:51.651+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.651767+0000) 2021-08-03T12:29:51.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:51.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.700256+0000) 2021-08-03T12:29:51.978 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:51.974+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.975484+0000) 2021-08-03T12:29:51.979 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:51.975+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:51.975751+0000) 2021-08-03T12:29:52.139 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:52.135+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:52.136245+0000) 2021-08-03T12:29:52.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:52.187+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:52.188502+0000) 2021-08-03T12:29:52.465 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:52.461+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:52.462599+0000) 2021-08-03T12:29:52.604 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:52.601+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:52.602324+0000) 2021-08-03T12:29:52.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:52.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:52.700361+0000) 2021-08-03T12:29:52.980 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:52.976+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:52.977289+0000) 2021-08-03T12:29:53.140 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:53.136+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:53.137125+0000) 2021-08-03T12:29:53.192 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:53.188+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:53.189280+0000) 2021-08-03T12:29:53.466 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:53.462+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:53.463565+0000) 2021-08-03T12:29:53.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:53.601+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:53.602469+0000) 2021-08-03T12:29:53.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:53.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:53.700482+0000) 2021-08-03T12:29:53.981 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:53.977+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:53.977885+0000) 2021-08-03T12:29:54.141 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:54.137+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:54.137899+0000) 2021-08-03T12:29:54.193 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:54.189+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:54.190078+0000) 2021-08-03T12:29:54.295 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:29:54.276+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7033 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:29:54.467 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:54.463+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:54.464133+0000) 2021-08-03T12:29:54.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:54.601+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:54.602619+0000) 2021-08-03T12:29:54.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:54.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:54.700597+0000) 2021-08-03T12:29:54.833 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:29:54.828+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6855 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:29:55.141 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:55.137+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:55.138476+0000) 2021-08-03T12:29:55.194 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:55.190+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:55.191007+0000) 2021-08-03T12:29:55.467 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:55.463+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:55.464803+0000) 2021-08-03T12:29:55.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:55.601+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:55.602769+0000) 2021-08-03T12:29:55.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:55.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:55.700747+0000) 2021-08-03T12:29:55.885 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:29:55.880+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:55.881302+0000) 2021-08-03T12:29:56.142 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:56.138+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:56.139302+0000) 2021-08-03T12:29:56.271 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:29:56.266+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:56.267024+0000) 2021-08-03T12:29:56.295 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:29:56.289+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:56.290369+0000) 2021-08-03T12:29:56.468 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:56.464+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:56.465557+0000) 2021-08-03T12:29:56.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:56.602+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:56.602892+0000) 2021-08-03T12:29:56.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:56.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:56.700892+0000) 2021-08-03T12:29:57.143 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:57.139+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:57.139900+0000) 2021-08-03T12:29:57.270 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:57.266+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:57.267579+0000) 2021-08-03T12:29:57.471 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:57.466+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:57.467615+0000) 2021-08-03T12:29:57.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:57.602+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:57.603022+0000) 2021-08-03T12:29:57.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:57.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:57.701028+0000) 2021-08-03T12:29:57.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:57.784+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:57.785475+0000) 2021-08-03T12:29:57.895 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:29:57.892+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:57.893387+0000) 2021-08-03T12:29:58.145 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:29:58.139+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:58.140510+0000) 2021-08-03T12:29:58.244 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:29:58.239+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:58.240178+0000) 2021-08-03T12:29:58.472 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:58.468+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:58.469241+0000) 2021-08-03T12:29:58.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:58.602+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:58.603129+0000) 2021-08-03T12:29:58.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:58.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:58.701147+0000) 2021-08-03T12:29:58.762 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:29:58.757+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:58.758493+0000) 2021-08-03T12:29:59.042 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:29:59.037+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:59.037927+0000) 2021-08-03T12:29:59.473 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:29:59.469+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:59.470166+0000) 2021-08-03T12:29:59.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:59.602+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:59.603265+0000) 2021-08-03T12:29:59.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:29:59.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:29:59.701279+0000) 2021-08-03T12:30:00.142 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:00.137+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:00.138228+0000) 2021-08-03T12:30:00.474 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:00.470+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:00.471092+0000) 2021-08-03T12:30:00.507 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:00.454+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7042 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:00.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:00.602+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:00.603442+0000) 2021-08-03T12:30:00.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:00.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:00.701401+0000) 2021-08-03T12:30:01.425 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:30:01.117+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:30:01.477 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:01.471+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:01.471987+0000) 2021-08-03T12:30:01.567 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:01.563+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:01.564732+0000) 2021-08-03T12:30:01.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:01.602+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:01.603591+0000) 2021-08-03T12:30:02.490 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:02.485+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:02.486621+0000) 2021-08-03T12:30:02.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:02.602+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:02.603691+0000) 2021-08-03T12:30:02.665 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:02.528+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6873 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:03.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:03.603+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:03.603847+0000) 2021-08-03T12:30:03.708 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:03.703+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:03.704444+0000) 2021-08-03T12:30:03.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:03.735+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:03.736224+0000) 2021-08-03T12:30:03.875 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:03.871+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:03.872133+0000) 2021-08-03T12:30:04.208 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:04.203+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:04.204259+0000) 2021-08-03T12:30:04.559 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:04.556+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:04.557298+0000) 2021-08-03T12:30:04.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:04.603+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:04.603991+0000) 2021-08-03T12:30:04.674 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:04.669+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:04.670445+0000) 2021-08-03T12:30:04.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:04.737+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:04.738629+0000) 2021-08-03T12:30:04.876 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:04.872+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:04.873771+0000) 2021-08-03T12:30:05.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:05.603+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:05.604124+0000) 2021-08-03T12:30:05.646 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:05.641+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:05.642464+0000) 2021-08-03T12:30:05.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:05.740+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:05.741245+0000) 2021-08-03T12:30:05.877 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:05.874+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:05.874870+0000) 2021-08-03T12:30:06.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:06.603+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:06.604242+0000) 2021-08-03T12:30:06.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:06.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:06.627651+0000) 2021-08-03T12:30:06.743 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:06.740+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:06.741433+0000) 2021-08-03T12:30:06.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:06.786+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:06.786881+0000) 2021-08-03T12:30:06.804 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:06.800+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:06.800944+0000) 2021-08-03T12:30:06.878 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:06.874+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:06.875466+0000) 2021-08-03T12:30:07.513 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:07.506+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7059 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:07.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:07.627+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:07.627802+0000) 2021-08-03T12:30:07.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:07.740+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:07.741555+0000) 2021-08-03T12:30:08.103 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:08.098+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:08.099000+0000) 2021-08-03T12:30:08.616 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:08.569+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6877 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:08.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:08.627+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:08.627982+0000) 2021-08-03T12:30:08.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:08.740+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:08.741771+0000) 2021-08-03T12:30:09.290 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:09.285+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:09.286668+0000) 2021-08-03T12:30:09.318 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:09.313+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:09.314241+0000) 2021-08-03T12:30:09.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:09.741+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:09.741902+0000) 2021-08-03T12:30:09.840 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:09.836+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:09.836981+0000) 2021-08-03T12:30:09.898 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:30:09.632+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:30:10.029 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:10.024+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:10.026302+0000) 2021-08-03T12:30:10.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:10.741+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:10.742100+0000) 2021-08-03T12:30:11.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:11.221+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:11.222643+0000) 2021-08-03T12:30:11.343 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:11.338+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:11.340138+0000) 2021-08-03T12:30:11.423 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:11.417+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:11.419251+0000) 2021-08-03T12:30:11.576 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:11.570+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:11.572445+0000) 2021-08-03T12:30:11.744 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:11.741+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:11.742242+0000) 2021-08-03T12:30:11.899 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:11.895+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:11.897516+0000) 2021-08-03T12:30:11.974 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:11.970+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:11.970915+0000) 2021-08-03T12:30:12.344 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:12.339+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:12.341434+0000) 2021-08-03T12:30:12.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:12.741+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:12.742464+0000) 2021-08-03T12:30:13.345 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:13.340+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:13.342372+0000) 2021-08-03T12:30:13.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:13.741+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:13.742593+0000) 2021-08-03T12:30:13.782 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:13.718+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7066 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:14.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:14.742+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:14.742805+0000) 2021-08-03T12:30:14.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:14.873+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:14.874549+0000) 2021-08-03T12:30:15.483 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:15.477+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:15.478078+0000) 2021-08-03T12:30:15.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:15.578+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:15.579291+0000) 2021-08-03T12:30:15.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:15.742+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:15.742934+0000) 2021-08-03T12:30:15.769 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:15.687+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6898 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:16.015 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:16.010+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:16.010989+0000) 2021-08-03T12:30:16.199 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:16.195+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:16.196103+0000) 2021-08-03T12:30:16.397 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:16.392+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:16.392835+0000) 2021-08-03T12:30:16.634 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:16.631+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:16.632183+0000) 2021-08-03T12:30:16.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:16.742+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:16.743147+0000) 2021-08-03T12:30:17.201 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:17.196+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:17.196837+0000) 2021-08-03T12:30:17.226 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:17.221+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:17.222134+0000) 2021-08-03T12:30:17.311 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:17.306+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:17.307331+0000) 2021-08-03T12:30:17.364 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:17.360+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:17.361062+0000) 2021-08-03T12:30:17.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:17.742+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:17.743273+0000) 2021-08-03T12:30:18.201 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:18.196+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:18.197411+0000) 2021-08-03T12:30:18.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:18.516+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:18.517194+0000) 2021-08-03T12:30:18.724 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:18.718+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:18.719551+0000) 2021-08-03T12:30:18.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:18.742+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:18.743546+0000) 2021-08-03T12:30:19.201 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:19.197+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:19.198111+0000) 2021-08-03T12:30:19.273 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:30:19.089+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:30:19.520 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:19.515+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:19.517352+0000) 2021-08-03T12:30:19.535 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:19.530+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:19.532672+0000) 2021-08-03T12:30:19.603 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:19.598+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:19.599185+0000) 2021-08-03T12:30:19.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:19.741+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:19.743695+0000) 2021-08-03T12:30:19.895 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:19.862+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7068 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:20.202 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:20.197+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:20.198759+0000) 2021-08-03T12:30:20.429 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:20.424+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:20.425760+0000) 2021-08-03T12:30:20.536 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:20.531+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:20.533344+0000) 2021-08-03T12:30:20.608 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:20.602+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:20.603924+0000) 2021-08-03T12:30:20.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:20.742+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:20.743886+0000) 2021-08-03T12:30:21.202 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:21.197+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:21.199375+0000) 2021-08-03T12:30:21.352 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:21.348+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:21.349889+0000) 2021-08-03T12:30:21.478 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:21.474+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:21.474998+0000) 2021-08-03T12:30:21.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:21.520+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:21.521873+0000) 2021-08-03T12:30:21.537 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:21.532+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:21.533912+0000) 2021-08-03T12:30:22.203 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:22.198+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:22.200007+0000) 2021-08-03T12:30:22.310 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:22.305+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:22.306908+0000) 2021-08-03T12:30:22.479 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:22.475+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:22.476348+0000) 2021-08-03T12:30:22.537 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:22.532+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:22.534534+0000) 2021-08-03T12:30:22.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:22.615+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:22.616966+0000) 2021-08-03T12:30:23.161 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:23.156+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:23.158299+0000) 2021-08-03T12:30:23.203 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:23.198+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:23.200600+0000) 2021-08-03T12:30:23.289 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:23.100+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6929 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:23.309 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:23.305+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:23.307048+0000) 2021-08-03T12:30:23.480 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:23.476+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:23.476950+0000) 2021-08-03T12:30:23.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:23.703+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:23.704659+0000) 2021-08-03T12:30:24.162 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:24.157+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:24.158848+0000) 2021-08-03T12:30:24.204 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:24.199+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:24.201222+0000) 2021-08-03T12:30:24.481 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:24.476+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:24.477584+0000) 2021-08-03T12:30:25.162 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:25.157+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:25.159390+0000) 2021-08-03T12:30:25.204 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:25.200+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:25.201827+0000) 2021-08-03T12:30:25.404 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:25.399+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:25.400906+0000) 2021-08-03T12:30:25.427 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:25.423+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:25.424916+0000) 2021-08-03T12:30:25.481 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:25.477+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:25.478421+0000) 2021-08-03T12:30:26.163 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:26.158+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:26.159917+0000) 2021-08-03T12:30:26.205 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:26.200+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:26.202444+0000) 2021-08-03T12:30:26.427 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:26.423+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:26.425058+0000) 2021-08-03T12:30:26.482 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:26.478+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:26.479427+0000) 2021-08-03T12:30:27.160 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:27.155+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7072 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:27.163 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:27.158+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:27.160519+0000) 2021-08-03T12:30:27.206 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:27.201+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:27.203359+0000) 2021-08-03T12:30:27.427 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:27.423+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:27.425161+0000) 2021-08-03T12:30:27.483 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:27.479+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:27.480009+0000) 2021-08-03T12:30:28.164 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:28.160+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:28.161462+0000) 2021-08-03T12:30:28.207 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:28.203+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:28.203926+0000) 2021-08-03T12:30:28.427 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:28.424+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:28.425280+0000) 2021-08-03T12:30:28.963 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:28.959+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:28.959842+0000) 2021-08-03T12:30:28.985 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:28.980+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:28.981773+0000) 2021-08-03T12:30:29.165 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:29.161+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:29.162091+0000) 2021-08-03T12:30:29.208 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:29.204+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:29.204702+0000) 2021-08-03T12:30:29.269 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:29.266+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:29.267152+0000) 2021-08-03T12:30:29.348 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:30:29.214+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:30:29.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:29.405+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:29.406623+0000) 2021-08-03T12:30:29.427 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:29.424+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:29.425434+0000) 2021-08-03T12:30:30.064 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:30.060+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:30.061065+0000) 2021-08-03T12:30:30.109 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:30.105+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:30.106225+0000) 2021-08-03T12:30:30.112 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:30.067+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6940 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:30.165 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:30.162+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:30.162683+0000) 2021-08-03T12:30:30.197 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:30.191+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:30.192439+0000) 2021-08-03T12:30:30.208 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:30.204+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:30.205531+0000) 2021-08-03T12:30:30.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:30.405+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:30.406762+0000) 2021-08-03T12:30:30.427 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:30.424+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:30.425565+0000) 2021-08-03T12:30:31.111 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:31.107+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:31.107869+0000) 2021-08-03T12:30:31.209 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:31.205+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:31.206170+0000) 2021-08-03T12:30:31.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:31.234+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:31.235353+0000) 2021-08-03T12:30:31.299 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:31.296+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:31.297302+0000) 2021-08-03T12:30:31.485 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:31.481+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:31.482660+0000) 2021-08-03T12:30:32.111 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:32.107+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:32.108454+0000) 2021-08-03T12:30:32.210 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:32.206+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:32.206761+0000) 2021-08-03T12:30:32.486 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:32.482+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:32.483342+0000) 2021-08-03T12:30:33.112 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:33.108+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:33.109033+0000) 2021-08-03T12:30:33.210 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:33.206+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:33.207346+0000) 2021-08-03T12:30:33.487 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:33.483+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:33.483909+0000) 2021-08-03T12:30:33.816 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:33.812+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:33.812932+0000) 2021-08-03T12:30:34.113 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:34.108+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:34.109689+0000) 2021-08-03T12:30:34.211 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:34.207+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:34.207936+0000) 2021-08-03T12:30:34.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:34.450+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:34.451047+0000) 2021-08-03T12:30:34.487 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:34.483+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:34.484465+0000) 2021-08-03T12:30:34.565 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:34.537+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7084 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:35.113 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:35.109+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:35.110287+0000) 2021-08-03T12:30:35.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:35.131+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:35.132768+0000) 2021-08-03T12:30:35.212 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:35.208+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:35.208792+0000) 2021-08-03T12:30:36.114 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:36.110+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:36.110905+0000) 2021-08-03T12:30:36.213 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:36.208+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:36.209387+0000) 2021-08-03T12:30:37.115 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:37.110+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:37.111729+0000) 2021-08-03T12:30:37.213 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:37.209+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:37.210116+0000) 2021-08-03T12:30:37.490 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:30:37.290+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:30:37.588 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:37.419+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6948 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:38.115 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:38.111+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:38.112332+0000) 2021-08-03T12:30:38.214 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:38.209+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:38.210681+0000) 2021-08-03T12:30:38.927 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:38.923+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:38.924654+0000) 2021-08-03T12:30:39.116 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:39.112+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:39.112918+0000) 2021-08-03T12:30:39.214 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:39.210+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:39.211266+0000) 2021-08-03T12:30:39.788 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:39.784+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:39.784810+0000) 2021-08-03T12:30:39.823 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:39.820+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:39.821049+0000) 2021-08-03T12:30:40.019 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:40.016+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:40.016987+0000) 2021-08-03T12:30:40.116 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:40.112+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:40.113524+0000) 2021-08-03T12:30:40.215 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:40.211+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:40.211847+0000) 2021-08-03T12:30:40.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:40.295+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:40.295937+0000) 2021-08-03T12:30:40.385 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:40.380+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:40.380955+0000) 2021-08-03T12:30:40.434 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:40.429+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7089 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:40.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:40.787+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:40.788235+0000) 2021-08-03T12:30:41.019 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:41.016+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:41.017130+0000) 2021-08-03T12:30:41.118 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:41.114+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:41.115028+0000) 2021-08-03T12:30:41.215 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:41.211+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:41.212445+0000) 2021-08-03T12:30:41.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:41.295+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:41.296079+0000) 2021-08-03T12:30:41.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:41.743+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:41.744276+0000) 2021-08-03T12:30:41.889 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:41.884+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:41.885239+0000) 2021-08-03T12:30:42.019 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:42.016+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:42.017267+0000) 2021-08-03T12:30:42.118 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:42.114+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:42.115605+0000) 2021-08-03T12:30:42.216 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:42.212+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:42.213052+0000) 2021-08-03T12:30:42.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:42.295+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:42.296239+0000) 2021-08-03T12:30:42.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:42.747+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:42.748533+0000) 2021-08-03T12:30:42.765 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:42.760+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:42.761744+0000) 2021-08-03T12:30:43.019 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:43.016+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:43.017402+0000) 2021-08-03T12:30:43.119 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:43.115+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:43.116400+0000) 2021-08-03T12:30:43.217 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:43.212+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:43.213628+0000) 2021-08-03T12:30:43.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:43.295+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:43.296387+0000) 2021-08-03T12:30:43.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:43.750+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:43.751738+0000) 2021-08-03T12:30:43.910 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:43.905+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:43.906133+0000) 2021-08-03T12:30:43.931 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:43.901+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6958 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:44.020 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:44.016+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:44.017544+0000) 2021-08-03T12:30:44.120 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:44.116+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:44.116998+0000) 2021-08-03T12:30:44.218 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:44.213+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:44.214698+0000) 2021-08-03T12:30:44.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:44.295+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:44.296511+0000) 2021-08-03T12:30:44.352 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:44.346+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:44.346878+0000) 2021-08-03T12:30:44.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:44.751+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:44.751994+0000) 2021-08-03T12:30:45.121 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:45.117+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:45.117910+0000) 2021-08-03T12:30:45.219 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:45.214+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:45.215633+0000) 2021-08-03T12:30:45.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:45.751+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:45.752116+0000) 2021-08-03T12:30:45.822 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:45.819+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:45.820032+0000) 2021-08-03T12:30:46.121 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:46.117+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:46.118519+0000) 2021-08-03T12:30:46.220 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:46.215+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:46.216536+0000) 2021-08-03T12:30:46.392 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:46.388+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:46.388848+0000) 2021-08-03T12:30:46.411 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:46.408+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:46.409280+0000) 2021-08-03T12:30:46.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:46.751+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:46.752341+0000) 2021-08-03T12:30:46.835 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:46.830+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:46.831451+0000) 2021-08-03T12:30:47.074 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:47.069+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:47.070455+0000) 2021-08-03T12:30:47.122 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:47.118+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:47.119345+0000) 2021-08-03T12:30:47.220 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:47.216+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:47.217625+0000) 2021-08-03T12:30:47.571 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:47.565+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:47.566334+0000) 2021-08-03T12:30:47.587 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:47.582+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:47.583282+0000) 2021-08-03T12:30:47.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:47.751+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:47.752486+0000) 2021-08-03T12:30:47.781 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:47.631+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7096 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:48.123 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:48.119+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:48.119925+0000) 2021-08-03T12:30:48.221 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:48.217+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:48.218537+0000) 2021-08-03T12:30:48.491 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:48.487+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:48.488558+0000) 2021-08-03T12:30:48.588 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:48.583+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:48.584528+0000) 2021-08-03T12:30:48.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:48.751+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:48.752721+0000) 2021-08-03T12:30:49.123 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:49.119+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:49.120524+0000) 2021-08-03T12:30:49.222 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:49.218+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:49.219491+0000) 2021-08-03T12:30:49.492 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:49.488+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:49.489362+0000) 2021-08-03T12:30:49.589 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:49.585+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:49.586074+0000) 2021-08-03T12:30:49.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:49.752+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:49.752853+0000) 2021-08-03T12:30:49.989 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:30:49.786+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:30:50.124 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:50.120+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:50.121109+0000) 2021-08-03T12:30:50.223 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:50.219+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:50.220403+0000) 2021-08-03T12:30:50.493 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:50.489+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:50.490320+0000) 2021-08-03T12:30:50.591 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:50.585+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:50.586628+0000) 2021-08-03T12:30:50.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:50.752+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:50.753045+0000) 2021-08-03T12:30:51.125 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:51.121+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:51.121878+0000) 2021-08-03T12:30:51.169 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:51.165+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:51.166310+0000) 2021-08-03T12:30:51.224 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:51.220+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:51.221329+0000) 2021-08-03T12:30:51.318 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:51.185+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6965 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:51.494 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:51.490+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:51.490918+0000) 2021-08-03T12:30:51.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:51.616+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:51.617368+0000) 2021-08-03T12:30:51.758 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:51.752+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:51.753157+0000) 2021-08-03T12:30:52.125 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:52.121+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:52.122707+0000) 2021-08-03T12:30:52.170 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:52.166+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:52.167019+0000) 2021-08-03T12:30:52.225 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:52.221+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:52.222284+0000) 2021-08-03T12:30:52.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:52.752+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:52.753395+0000) 2021-08-03T12:30:53.127 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:53.122+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:53.123624+0000) 2021-08-03T12:30:53.170 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:30:53.166+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:53.167581+0000) 2021-08-03T12:30:53.226 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:53.222+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:53.223386+0000) 2021-08-03T12:30:53.542 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:53.538+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:53.538893+0000) 2021-08-03T12:30:53.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:53.752+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:53.753517+0000) 2021-08-03T12:30:54.127 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:54.123+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:54.124259+0000) 2021-08-03T12:30:54.228 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:54.223+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:54.224545+0000) 2021-08-03T12:30:54.543 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:54.539+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:54.539921+0000) 2021-08-03T12:30:54.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:54.752+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:54.753783+0000) 2021-08-03T12:30:54.854 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:30:54.573+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7120 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:30:55.128 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:55.124+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:55.124835+0000) 2021-08-03T12:30:55.228 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:55.224+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:55.225556+0000) 2021-08-03T12:30:55.544 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:55.540+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:55.540731+0000) 2021-08-03T12:30:55.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:55.753+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:55.753933+0000) 2021-08-03T12:30:56.128 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:56.124+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:56.125436+0000) 2021-08-03T12:30:56.231 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:30:56.225+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:56.226441+0000) 2021-08-03T12:30:56.470 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:30:56.259+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:30:56.527 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:30:56.524+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:56.525374+0000) 2021-08-03T12:30:56.544 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:56.540+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:56.541342+0000) 2021-08-03T12:30:56.721 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:30:56.715+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:56.715946+0000) 2021-08-03T12:30:56.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:56.753+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:56.754144+0000) 2021-08-03T12:30:57.129 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:57.125+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:57.126078+0000) 2021-08-03T12:30:57.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:30:57.261+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:57.262731+0000) 2021-08-03T12:30:57.494 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:57.490+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:57.491560+0000) 2021-08-03T12:30:57.545 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:57.541+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:57.541943+0000) 2021-08-03T12:30:57.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:57.753+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:57.754260+0000) 2021-08-03T12:30:57.922 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:57.919+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:57.919849+0000) 2021-08-03T12:30:58.129 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:58.125+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:58.126781+0000) 2021-08-03T12:30:58.395 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:30:58.226+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 6981 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:30:58.546 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:58.541+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:58.542526+0000) 2021-08-03T12:30:58.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:58.753+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:58.754499+0000) 2021-08-03T12:30:59.131 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:30:59.126+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:59.127433+0000) 2021-08-03T12:30:59.350 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:30:59.344+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:59.345557+0000) 2021-08-03T12:30:59.422 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:30:59.416+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:59.417588+0000) 2021-08-03T12:30:59.546 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:30:59.542+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:59.543120+0000) 2021-08-03T12:30:59.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:59.753+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:59.754618+0000) 2021-08-03T12:30:59.919 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:30:59.916+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:30:59.917221+0000) 2021-08-03T12:31:00.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:00.754+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:00.754849+0000) 2021-08-03T12:31:01.428 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:01.425+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:01.425978+0000) 2021-08-03T12:31:01.509 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:01.448+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7127 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:01.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:01.754+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:01.754981+0000) 2021-08-03T12:31:02.025 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:02.019+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:02.020704+0000) 2021-08-03T12:31:02.428 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:02.425+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:02.426130+0000) 2021-08-03T12:31:02.823 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:02.820+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:02.820935+0000) 2021-08-03T12:31:03.428 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:03.425+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:03.426275+0000) 2021-08-03T12:31:03.859 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:03.545+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:04.127 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:04.122+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:04.123360+0000) 2021-08-03T12:31:04.429 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:04.425+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:04.426431+0000) 2021-08-03T12:31:05.300 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:05.294+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:05.296509+0000) 2021-08-03T12:31:05.429 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:05.424+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:05.426561+0000) 2021-08-03T12:31:06.429 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:06.424+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:06.426701+0000) 2021-08-03T12:31:06.747 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:06.224+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7004 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:06.886 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:06.882+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:06.882950+0000) 2021-08-03T12:31:07.350 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:07.347+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:07.348506+0000) 2021-08-03T12:31:07.645 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:07.641+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7128 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:08.064 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:08.059+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:08.060516+0000) 2021-08-03T12:31:09.016 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:09.011+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:09.012460+0000) 2021-08-03T12:31:09.422 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:09.418+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:09.419855+0000) 2021-08-03T12:31:10.146 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:10.141+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:10.142256+0000) 2021-08-03T12:31:10.280 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:10.274+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:10.276442+0000) 2021-08-03T12:31:10.595 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:10.590+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:10.592642+0000) 2021-08-03T12:31:10.599 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:10.595+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:10.597164+0000) 2021-08-03T12:31:10.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:10.642+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:10.644214+0000) 2021-08-03T12:31:11.649 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:11.644+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:11.646645+0000) 2021-08-03T12:31:12.145 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:12.138+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:12.183 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:12.003+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7013 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:12.208 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:12.202+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:12.203771+0000) 2021-08-03T12:31:12.499 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:12.494+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:12.496409+0000) 2021-08-03T12:31:13.500 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:13.495+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:13.497131+0000) 2021-08-03T12:31:14.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:14.042+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:14.043685+0000) 2021-08-03T12:31:14.353 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:14.348+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:14.349847+0000) 2021-08-03T12:31:14.613 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:14.608+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:14.608722+0000) 2021-08-03T12:31:14.641 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:14.636+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:14.638287+0000) 2021-08-03T12:31:14.865 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:14.861+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:14.862401+0000) 2021-08-03T12:31:15.353 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:15.348+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:15.350611+0000) 2021-08-03T12:31:15.642 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:15.637+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:15.639104+0000) 2021-08-03T12:31:16.087 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:16.063+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7128 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:16.643 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:16.638+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:16.640006+0000) 2021-08-03T12:31:16.993 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:16.987+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:16.989348+0000) 2021-08-03T12:31:17.644 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:17.638+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:17.640628+0000) 2021-08-03T12:31:17.684 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:17.681+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:17.682082+0000) 2021-08-03T12:31:17.846 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:17.841+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:17.843600+0000) 2021-08-03T12:31:20.406 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:20.402+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7028 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:21.290 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:21.082+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:21.596 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:21.591+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:21.592329+0000) 2021-08-03T12:31:22.560 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:22.557+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:22.557898+0000) 2021-08-03T12:31:22.596 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:22.592+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:22.593120+0000) 2021-08-03T12:31:23.597 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:23.592+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:23.593766+0000) 2021-08-03T12:31:24.262 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:24.023+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7128 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:24.597 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:24.593+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:24.594396+0000) 2021-08-03T12:31:25.431 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:25.426+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:25.427260+0000) 2021-08-03T12:31:25.494 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:25.490+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:25.491647+0000) 2021-08-03T12:31:25.612 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:25.592+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7030 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:25.802 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:25.797+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:25.798130+0000) 2021-08-03T12:31:26.311 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:26.308+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:26.308856+0000) 2021-08-03T12:31:26.495 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:26.491+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:26.492334+0000) 2021-08-03T12:31:26.643 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:26.639+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:26.640597+0000) 2021-08-03T12:31:27.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:27.288+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:27.289840+0000) 2021-08-03T12:31:27.496 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:27.492+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:27.492904+0000) 2021-08-03T12:31:27.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:27.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:27.519684+0000) 2021-08-03T12:31:28.171 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:28.098+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:28.497 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:28.492+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:28.493449+0000) 2021-08-03T12:31:28.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:28.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:28.519843+0000) 2021-08-03T12:31:28.816 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:28.811+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:28.812363+0000) 2021-08-03T12:31:29.461 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:29.456+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:29.457168+0000) 2021-08-03T12:31:29.463 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:29.458+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:29.459491+0000) 2021-08-03T12:31:29.497 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:29.493+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:29.494055+0000) 2021-08-03T12:31:30.291 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:30.285+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:30.286645+0000) 2021-08-03T12:31:30.497 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:30.493+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:30.494644+0000) 2021-08-03T12:31:30.541 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:30.536+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:30.537324+0000) 2021-08-03T12:31:30.550 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:30.546+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:30.547362+0000) 2021-08-03T12:31:30.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:30.719+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:30.720538+0000) 2021-08-03T12:31:30.747 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:30.697+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7128 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:31.498 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:31.494+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:31.495559+0000) 2021-08-03T12:31:31.551 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:31.547+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:31.548001+0000) 2021-08-03T12:31:32.325 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:32.093+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7049 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:32.380 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:32.376+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:32.377152+0000) 2021-08-03T12:31:32.499 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:32.495+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:32.496133+0000) 2021-08-03T12:31:32.551 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:32.547+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:32.548578+0000) 2021-08-03T12:31:33.197 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:33.164+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:33.286 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:33.283+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:33.284028+0000) 2021-08-03T12:31:33.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:33.440+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:33.441063+0000) 2021-08-03T12:31:33.879 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:33.876+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:33.877385+0000) 2021-08-03T12:31:34.097 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:34.092+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:34.093003+0000) 2021-08-03T12:31:34.501 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:34.498+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:34.499487+0000) 2021-08-03T12:31:34.504 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:34.500+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:34.501007+0000) 2021-08-03T12:31:35.505 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:35.500+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:35.501733+0000) 2021-08-03T12:31:35.528 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:35.523+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:35.524772+0000) 2021-08-03T12:31:35.769 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:35.703+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7128 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:35.920 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:35.915+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:35.916693+0000) 2021-08-03T12:31:36.151 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:36.146+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:36.147266+0000) 2021-08-03T12:31:36.505 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:36.501+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:36.502380+0000) 2021-08-03T12:31:36.528 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:36.524+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:36.525504+0000) 2021-08-03T12:31:37.429 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:37.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:37.427099+0000) 2021-08-03T12:31:37.506 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:37.502+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:37.502985+0000) 2021-08-03T12:31:37.529 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:37.525+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:37.526291+0000) 2021-08-03T12:31:38.430 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:38.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:38.427262+0000) 2021-08-03T12:31:38.506 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:38.502+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:38.503608+0000) 2021-08-03T12:31:38.530 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:38.526+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:38.527172+0000) 2021-08-03T12:31:38.994 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:38.989+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:39.430 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:39.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:39.427412+0000) 2021-08-03T12:31:39.507 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:39.503+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:39.504206+0000) 2021-08-03T12:31:39.530 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:39.526+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:39.527748+0000) 2021-08-03T12:31:39.941 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:39.937+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:39.938692+0000) 2021-08-03T12:31:40.430 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:40.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:40.427538+0000) 2021-08-03T12:31:40.508 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:40.504+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:40.504871+0000) 2021-08-03T12:31:40.531 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:40.527+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:40.528342+0000) 2021-08-03T12:31:40.824 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:40.770+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7134 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:40.852 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:40.847+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:40.848601+0000) 2021-08-03T12:31:40.999 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:40.994+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:40.995191+0000) 2021-08-03T12:31:41.115 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:40.927+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7073 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:41.381 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:41.376+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:41.377102+0000) 2021-08-03T12:31:41.385 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:41.380+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:41.381001+0000) 2021-08-03T12:31:41.430 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:41.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:41.427677+0000) 2021-08-03T12:31:41.531 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:41.528+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:41.528926+0000) 2021-08-03T12:31:42.220 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:42.216+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:42.217751+0000) 2021-08-03T12:31:42.491 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:42.487+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:42.488282+0000) 2021-08-03T12:31:42.532 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:42.528+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:42.529332+0000) 2021-08-03T12:31:42.894 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:42.889+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:42.890449+0000) 2021-08-03T12:31:43.533 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:43.529+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:43.529917+0000) 2021-08-03T12:31:43.754 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:43.750+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:43.750967+0000) 2021-08-03T12:31:44.180 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:44.176+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:44.176944+0000) 2021-08-03T12:31:44.533 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:44.529+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:44.530506+0000) 2021-08-03T12:31:45.013 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:45.009+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:45.010566+0000) 2021-08-03T12:31:45.020 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:45.017+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:45.018259+0000) 2021-08-03T12:31:45.181 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:45.176+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:45.177631+0000) 2021-08-03T12:31:45.405 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:45.400+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:45.401069+0000) 2021-08-03T12:31:45.534 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:45.530+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:45.530998+0000) 2021-08-03T12:31:45.954 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:45.950+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:45.985 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:45.981+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:45.982508+0000) 2021-08-03T12:31:46.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:46.017+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:46.018422+0000) 2021-08-03T12:31:46.181 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:46.177+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:46.178297+0000) 2021-08-03T12:31:46.359 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:46.355+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:46.356109+0000) 2021-08-03T12:31:46.534 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:46.530+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:46.531688+0000) 2021-08-03T12:31:46.584 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:46.485+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7134 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:46.706 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:46.701+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7082 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:47.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:47.017+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:47.018550+0000) 2021-08-03T12:31:47.602 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:47.597+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:47.598166+0000) 2021-08-03T12:31:47.945 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:47.939+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:47.940608+0000) 2021-08-03T12:31:48.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:48.017+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:48.018686+0000) 2021-08-03T12:31:48.041 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:48.038+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:48.038861+0000) 2021-08-03T12:31:48.141 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:48.136+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:48.137166+0000) 2021-08-03T12:31:48.237 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:48.232+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:48.233210+0000) 2021-08-03T12:31:48.423 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:48.419+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:48.420419+0000) 2021-08-03T12:31:48.592 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:48.587+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:48.587822+0000) 2021-08-03T12:31:48.669 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:48.665+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:48.665940+0000) 2021-08-03T12:31:49.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:49.017+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:49.018823+0000) 2021-08-03T12:31:49.338 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:49.333+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:49.334202+0000) 2021-08-03T12:31:49.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:49.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:49.520317+0000) 2021-08-03T12:31:50.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:50.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:50.018927+0000) 2021-08-03T12:31:50.405 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:50.401+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:50.402809+0000) 2021-08-03T12:31:50.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:50.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:50.520439+0000) 2021-08-03T12:31:51.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:51.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:51.019065+0000) 2021-08-03T12:31:51.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:51.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:51.520564+0000) 2021-08-03T12:31:51.960 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:51.956+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7134 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:52.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:52.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:52.019189+0000) 2021-08-03T12:31:52.467 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:52.462+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:52.464704+0000) 2021-08-03T12:31:52.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:52.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:52.520693+0000) 2021-08-03T12:31:52.727 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:52.722+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:52.723713+0000) 2021-08-03T12:31:52.772 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:52.731+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7082 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:52.777 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:52.538+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:31:53.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:53.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:53.019316+0000) 2021-08-03T12:31:53.248 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:53.243+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:53.244728+0000) 2021-08-03T12:31:53.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:53.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:53.520810+0000) 2021-08-03T12:31:53.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:53.912+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:53.913958+0000) 2021-08-03T12:31:54.021 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:54.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:54.019450+0000) 2021-08-03T12:31:54.043 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:54.039+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:54.041201+0000) 2021-08-03T12:31:54.290 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:54.286+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:54.287634+0000) 2021-08-03T12:31:54.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:54.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:54.520972+0000) 2021-08-03T12:31:55.022 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:55.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.019582+0000) 2021-08-03T12:31:55.049 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:31:55.044+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.045674+0000) 2021-08-03T12:31:55.060 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:55.054+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.056147+0000) 2021-08-03T12:31:55.292 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:55.287+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.288618+0000) 2021-08-03T12:31:55.334 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:31:55.328+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.329964+0000) 2021-08-03T12:31:55.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:55.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.521134+0000) 2021-08-03T12:31:55.591 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:55.586+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.588157+0000) 2021-08-03T12:31:55.601 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:55.597+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.597869+0000) 2021-08-03T12:31:55.874 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:31:55.868+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:55.870306+0000) 2021-08-03T12:31:56.022 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:56.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:56.019719+0000) 2021-08-03T12:31:56.292 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:56.288+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:56.289442+0000) 2021-08-03T12:31:56.442 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:31:56.437+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:56.438186+0000) 2021-08-03T12:31:56.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:56.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:56.521272+0000) 2021-08-03T12:31:56.592 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:56.587+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:56.588752+0000) 2021-08-03T12:31:56.601 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:56.597+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:56.598576+0000) 2021-08-03T12:31:57.022 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:57.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:57.019853+0000) 2021-08-03T12:31:57.268 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:31:57.227+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7134 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:31:57.293 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:57.289+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:57.290502+0000) 2021-08-03T12:31:57.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:57.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:57.521427+0000) 2021-08-03T12:31:57.602 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:57.598+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:57.599143+0000) 2021-08-03T12:31:57.929 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:57.925+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:57.926854+0000) 2021-08-03T12:31:57.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:31:57.968+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:57.970262+0000) 2021-08-03T12:31:58.295 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:31:58.290+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:58.291509+0000) 2021-08-03T12:31:58.603 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:31:58.599+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:58.599967+0000) 2021-08-03T12:31:58.889 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:31:58.883+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:58.885358+0000) 2021-08-03T12:31:58.902 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:31:58.598+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7090 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:31:59.141 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:31:59.135+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:59.136989+0000) 2021-08-03T12:31:59.888 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:31:59.885+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:31:59.886169+0000) 2021-08-03T12:32:00.108 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:00.105+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:00.106046+0000) 2021-08-03T12:32:00.169 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:31:59.696+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:01.513 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:01.509+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:01.510009+0000) 2021-08-03T12:32:01.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:01.694+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:01.695492+0000) 2021-08-03T12:32:01.836 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:01.830+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:01.831445+0000) 2021-08-03T12:32:02.026 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:02.021+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:02.022302+0000) 2021-08-03T12:32:02.504 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:02.499+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:02.500436+0000) 2021-08-03T12:32:02.513 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:02.509+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:02.510755+0000) 2021-08-03T12:32:02.728 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:02.706+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7134 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:02.848 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:02.843+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:02.843937+0000) 2021-08-03T12:32:03.170 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:03.166+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:03.167534+0000) 2021-08-03T12:32:03.406 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:03.401+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:03.402743+0000) 2021-08-03T12:32:03.502 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:03.498+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:03.499471+0000) 2021-08-03T12:32:03.514 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:03.510+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:03.511347+0000) 2021-08-03T12:32:03.555 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:03.551+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:03.552108+0000) 2021-08-03T12:32:03.923 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:03.920+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:03.921209+0000) 2021-08-03T12:32:04.503 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:04.499+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:04.500080+0000) 2021-08-03T12:32:04.515 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:04.511+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:04.512146+0000) 2021-08-03T12:32:04.556 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:04.552+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:04.552797+0000) 2021-08-03T12:32:05.504 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:05.500+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:05.500712+0000) 2021-08-03T12:32:05.515 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:05.511+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:05.512788+0000) 2021-08-03T12:32:05.521 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:05.518+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:05.519416+0000) 2021-08-03T12:32:05.533 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:05.527+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:05.528659+0000) 2021-08-03T12:32:05.557 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:05.552+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:05.553604+0000) 2021-08-03T12:32:05.670 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:05.525+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7135 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:06.505 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:06.500+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:06.501495+0000) 2021-08-03T12:32:06.516 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:06.512+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:06.513365+0000) 2021-08-03T12:32:06.619 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:06.562+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3087 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:06.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:06.672+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:06.673199+0000) 2021-08-03T12:32:06.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:06.760+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:06.761248+0000) 2021-08-03T12:32:06.878 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:06.873+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:06.874109+0000) 2021-08-03T12:32:06.989 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:06.986+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:06.987063+0000) 2021-08-03T12:32:07.249 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:07.244+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:07.245427+0000) 2021-08-03T12:32:07.505 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:07.501+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:07.502060+0000) 2021-08-03T12:32:07.517 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:07.513+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:07.513984+0000) 2021-08-03T12:32:07.992 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:07.988+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:07.989633+0000) 2021-08-03T12:32:08.505 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:08.501+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:08.502649+0000) 2021-08-03T12:32:08.517 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:08.513+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:08.514561+0000) 2021-08-03T12:32:08.738 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:08.732+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:08.732847+0000) 2021-08-03T12:32:08.785 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:08.725+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7134 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:08.947 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:08.944+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:08.945459+0000) 2021-08-03T12:32:08.995 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:08.992+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:08.993091+0000) 2021-08-03T12:32:09.506 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:09.502+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:09.503227+0000) 2021-08-03T12:32:09.518 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:09.514+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:09.515463+0000) 2021-08-03T12:32:09.634 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:09.630+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:09.630970+0000) 2021-08-03T12:32:09.995 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:09.992+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:09.993204+0000) 2021-08-03T12:32:10.235 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:10.232+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:10.233259+0000) 2021-08-03T12:32:10.507 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:10.503+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:10.503800+0000) 2021-08-03T12:32:10.519 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:10.515+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:10.516261+0000) 2021-08-03T12:32:10.941 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:10.938+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:10.939090+0000) 2021-08-03T12:32:10.996 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:10.992+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:10.993454+0000) 2021-08-03T12:32:11.507 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:11.503+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:11.504391+0000) 2021-08-03T12:32:11.520 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:11.516+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:11.516843+0000) 2021-08-03T12:32:11.941 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:11.938+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:11.939235+0000) 2021-08-03T12:32:11.996 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:11.992+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:11.993593+0000) 2021-08-03T12:32:12.270 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:12.265+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:12.266275+0000) 2021-08-03T12:32:12.430 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:12.427+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:12.428150+0000) 2021-08-03T12:32:12.452 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:12.431+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7147 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:12.521 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:12.516+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:12.517588+0000) 2021-08-03T12:32:13.209 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:13.138+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3087 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:13.521 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:13.518+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:13.518963+0000) 2021-08-03T12:32:13.522 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:13.517+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:13.518432+0000) 2021-08-03T12:32:13.672 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:13.668+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:13.669109+0000) 2021-08-03T12:32:14.404 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:14.398+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:14.399487+0000) 2021-08-03T12:32:14.522 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:14.518+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:14.519012+0000) 2021-08-03T12:32:14.567 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:14.129+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7144 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:14.671 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:14.667+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:14.667885+0000) 2021-08-03T12:32:14.989 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:14.985+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:14.986215+0000) 2021-08-03T12:32:15.120 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:15.116+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:15.117600+0000) 2021-08-03T12:32:15.523 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:15.519+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:15.519835+0000) 2021-08-03T12:32:16.111 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:16.108+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:16.108889+0000) 2021-08-03T12:32:16.179 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:16.174+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:16.175618+0000) 2021-08-03T12:32:16.508 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:16.502+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:16.503670+0000) 2021-08-03T12:32:16.523 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:16.519+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:16.520676+0000) 2021-08-03T12:32:16.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:16.521+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:16.522657+0000) 2021-08-03T12:32:17.180 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:17.175+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:17.176611+0000) 2021-08-03T12:32:17.187 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:17.183+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:17.184018+0000) 2021-08-03T12:32:17.366 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:17.362+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:17.363011+0000) 2021-08-03T12:32:17.414 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:17.411+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:17.412623+0000) 2021-08-03T12:32:17.525 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:17.520+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:17.521714+0000) 2021-08-03T12:32:17.914 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:17.909+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:17.910263+0000) 2021-08-03T12:32:17.995 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:17.972+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7151 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:18.022 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:18.019+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:18.020269+0000) 2021-08-03T12:32:18.180 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:18.176+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:18.177184+0000) 2021-08-03T12:32:18.187 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:18.183+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:18.184686+0000) 2021-08-03T12:32:18.366 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:18.362+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:18.363723+0000) 2021-08-03T12:32:18.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:18.521+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:18.521879+0000) 2021-08-03T12:32:18.525 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:18.521+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:18.522350+0000) 2021-08-03T12:32:19.022 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:19.019+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:19.020406+0000) 2021-08-03T12:32:19.185 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:19.176+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:19.177868+0000) 2021-08-03T12:32:19.188 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:19.184+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:19.185225+0000) 2021-08-03T12:32:19.367 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:19.362+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:19.364544+0000) 2021-08-03T12:32:19.504 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:19.472+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3087 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:19.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:19.521+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:19.522042+0000) 2021-08-03T12:32:19.526 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:19.521+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:19.522973+0000) 2021-08-03T12:32:19.590 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:19.585+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:19.586830+0000) 2021-08-03T12:32:20.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:20.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.020562+0000) 2021-08-03T12:32:20.182 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:20.177+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.179261+0000) 2021-08-03T12:32:20.189 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:20.185+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.186022+0000) 2021-08-03T12:32:20.361 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:20.356+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.357312+0000) 2021-08-03T12:32:20.368 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:20.363+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.365383+0000) 2021-08-03T12:32:20.378 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:20.374+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.375020+0000) 2021-08-03T12:32:20.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:20.521+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.522189+0000) 2021-08-03T12:32:20.527 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:20.522+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:20.524070+0000) 2021-08-03T12:32:21.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:21.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:21.020700+0000) 2021-08-03T12:32:21.183 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:21.178+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:21.179823+0000) 2021-08-03T12:32:21.189 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:21.185+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:21.186594+0000) 2021-08-03T12:32:21.370 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:21.364+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:21.366785+0000) 2021-08-03T12:32:21.378 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:21.374+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:21.375561+0000) 2021-08-03T12:32:21.528 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:21.523+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:21.524937+0000) 2021-08-03T12:32:21.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:21.615+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:21.616094+0000) 2021-08-03T12:32:21.856 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:21.789+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7176 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:22.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:22.018+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.020844+0000) 2021-08-03T12:32:22.190 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:22.186+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.187162+0000) 2021-08-03T12:32:22.370 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:22.365+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.367376+0000) 2021-08-03T12:32:22.379 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:22.375+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.376194+0000) 2021-08-03T12:32:22.529 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:22.523+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.525658+0000) 2021-08-03T12:32:22.558 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:22.554+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.555470+0000) 2021-08-03T12:32:22.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:22.626+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.626952+0000) 2021-08-03T12:32:22.987 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:22.981+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.983128+0000) 2021-08-03T12:32:22.993 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:22.989+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:22.991226+0000) 2021-08-03T12:32:23.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:23.019+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:23.020986+0000) 2021-08-03T12:32:23.041 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:23.036+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:23.037519+0000) 2021-08-03T12:32:23.380 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:23.376+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:23.377341+0000) 2021-08-03T12:32:23.529 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:23.524+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:23.526267+0000) 2021-08-03T12:32:23.936 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:23.804+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7156 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:23.957 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:23.953+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:23.953920+0000) 2021-08-03T12:32:24.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:24.019+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:24.021098+0000) 2021-08-03T12:32:24.269 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:24.264+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:24.265088+0000) 2021-08-03T12:32:24.381 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:24.377+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:24.378098+0000) 2021-08-03T12:32:24.530 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:24.525+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:24.526879+0000) 2021-08-03T12:32:24.600 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:24.594+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:24.595877+0000) 2021-08-03T12:32:25.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:25.019+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:25.021249+0000) 2021-08-03T12:32:25.110 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:25.107+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:25.107857+0000) 2021-08-03T12:32:25.531 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:25.525+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:25.527753+0000) 2021-08-03T12:32:25.928 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:25.732+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3087 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:26.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:26.019+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:26.021394+0000) 2021-08-03T12:32:26.532 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:26.527+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:26.528365+0000) 2021-08-03T12:32:27.024 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:27.020+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:27.021522+0000) 2021-08-03T12:32:27.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:27.082+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:27.083259+0000) 2021-08-03T12:32:27.222 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:27.216+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:27.217651+0000) 2021-08-03T12:32:27.532 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:27.528+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:27.529195+0000) 2021-08-03T12:32:27.829 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:27.806+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7195 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:28.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:28.146+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:28.147245+0000) 2021-08-03T12:32:28.533 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:28.529+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:28.530158+0000) 2021-08-03T12:32:28.676 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:28.671+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:28.671945+0000) 2021-08-03T12:32:29.177 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:29.174+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:29.175098+0000) 2021-08-03T12:32:29.534 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:29.529+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:29.530719+0000) 2021-08-03T12:32:29.606 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:29.602+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:29.603514+0000) 2021-08-03T12:32:29.668 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:29.665+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:29.666016+0000) 2021-08-03T12:32:30.079 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:30.074+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:30.075005+0000) 2021-08-03T12:32:30.534 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:30.530+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:30.531530+0000) 2021-08-03T12:32:30.607 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:30.603+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:30.604095+0000) 2021-08-03T12:32:31.348 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:31.344+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7170 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:31.536 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:31.531+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:31.532122+0000) 2021-08-03T12:32:31.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:31.555+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:31.556596+0000) 2021-08-03T12:32:31.608 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:31.603+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:31.604676+0000) 2021-08-03T12:32:31.716 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:31.710+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3089 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:32.031 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:32.028+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:32.029129+0000) 2021-08-03T12:32:32.396 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:32.391+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:32.391782+0000) 2021-08-03T12:32:32.609 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:32.604+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:32.605422+0000) 2021-08-03T12:32:32.996 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:32.993+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:32.994070+0000) 2021-08-03T12:32:33.565 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:33.560+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:33.560937+0000) 2021-08-03T12:32:33.594 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:33.589+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:33.590513+0000) 2021-08-03T12:32:33.609 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:33.605+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:33.606021+0000) 2021-08-03T12:32:33.897 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:33.891+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:33.892673+0000) 2021-08-03T12:32:33.936 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:33.931+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:33.932380+0000) 2021-08-03T12:32:33.999 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:33.995+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:33.996666+0000) 2021-08-03T12:32:34.036 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:34.032+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:34.033776+0000) 2021-08-03T12:32:34.373 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:34.369+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:34.370607+0000) 2021-08-03T12:32:34.610 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:34.605+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:34.606596+0000) 2021-08-03T12:32:34.928 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:34.686+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7207 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:34.957 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:34.951+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:34.952112+0000) 2021-08-03T12:32:34.957 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:34.952+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:34.953717+0000) 2021-08-03T12:32:35.001 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:34.998+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:34.998880+0000) 2021-08-03T12:32:36.001 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:35.998+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:35.999029+0000) 2021-08-03T12:32:36.532 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:36.525+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:36.526661+0000) 2021-08-03T12:32:36.562 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:36.558+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:36.558923+0000) 2021-08-03T12:32:36.716 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:36.710+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:36.711592+0000) 2021-08-03T12:32:37.002 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:36.998+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:36.999259+0000) 2021-08-03T12:32:37.551 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:37.386+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7189 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:37.562 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:37.558+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:37.559582+0000) 2021-08-03T12:32:37.736 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:37.731+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:37.732429+0000) 2021-08-03T12:32:38.002 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:37.997+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:37.999381+0000) 2021-08-03T12:32:39.002 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:38.997+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:38.999648+0000) 2021-08-03T12:32:39.110 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:39.107+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:39.108392+0000) 2021-08-03T12:32:39.208 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:39.202+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:39.204077+0000) 2021-08-03T12:32:39.470 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:39.464+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:39.466383+0000) 2021-08-03T12:32:39.602 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:39.229+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3093 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:40.044 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:40.039+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7227 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:40.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:40.324+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:40.326004+0000) 2021-08-03T12:32:40.461 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:40.456+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:40.457048+0000) 2021-08-03T12:32:40.907 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:40.904+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:40.904961+0000) 2021-08-03T12:32:41.157 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:41.151+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:41.153337+0000) 2021-08-03T12:32:41.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:41.520+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:41.522567+0000) 2021-08-03T12:32:41.893 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:41.888+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:41.889559+0000) 2021-08-03T12:32:42.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:42.520+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:42.522724+0000) 2021-08-03T12:32:42.918 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:42.912+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:42.914270+0000) 2021-08-03T12:32:42.942 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:42.937+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:42.939591+0000) 2021-08-03T12:32:43.023 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:43.018+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:43.019284+0000) 2021-08-03T12:32:43.431 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:43.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:43.428512+0000) 2021-08-03T12:32:43.464 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:43.261+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7191 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:43.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:43.521+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:43.522875+0000) 2021-08-03T12:32:43.942 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:43.937+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:43.939736+0000) 2021-08-03T12:32:44.431 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:44.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:44.428644+0000) 2021-08-03T12:32:44.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:44.521+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:44.522985+0000) 2021-08-03T12:32:44.812 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:44.807+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:44.808573+0000) 2021-08-03T12:32:44.942 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:44.938+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:44.939893+0000) 2021-08-03T12:32:45.382 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:45.377+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:45.378805+0000) 2021-08-03T12:32:45.431 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:45.426+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:45.428784+0000) 2021-08-03T12:32:45.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:45.521+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:45.523140+0000) 2021-08-03T12:32:45.615 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:45.612+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:45.613122+0000) 2021-08-03T12:32:45.814 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:45.810+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:45.812059+0000) 2021-08-03T12:32:45.942 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:45.938+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:45.940057+0000) 2021-08-03T12:32:46.358 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:46.353+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:46.354668+0000) 2021-08-03T12:32:46.431 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:46.428+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:46.428859+0000) 2021-08-03T12:32:46.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:46.522+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:46.523259+0000) 2021-08-03T12:32:46.942 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:46.939+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:46.940190+0000) 2021-08-03T12:32:47.184 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:47.163+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7248 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:47.272 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:47.268+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3095 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:47.431 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:47.428+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:47.428981+0000) 2021-08-03T12:32:47.485 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:47.480+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:47.481113+0000) 2021-08-03T12:32:47.487 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:47.484+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:47.485412+0000) 2021-08-03T12:32:47.503 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:47.498+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:47.499552+0000) 2021-08-03T12:32:47.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:47.522+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:47.523411+0000) 2021-08-03T12:32:47.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:47.939+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:47.940301+0000) 2021-08-03T12:32:47.946 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:47.940+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:47.941614+0000) 2021-08-03T12:32:48.024 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:48.021+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:48.021880+0000) 2021-08-03T12:32:48.165 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:48.162+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:48.162734+0000) 2021-08-03T12:32:48.384 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:48.379+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:48.380251+0000) 2021-08-03T12:32:48.621 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:48.616+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:48.617461+0000) 2021-08-03T12:32:48.762 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:48.757+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:48.758332+0000) 2021-08-03T12:32:48.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:48.939+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:48.940455+0000) 2021-08-03T12:32:49.024 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:49.021+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:49.022016+0000) 2021-08-03T12:32:49.167 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:49.162+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:49.163307+0000) 2021-08-03T12:32:49.660 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:49.622+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7193 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:49.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:49.939+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:49.940582+0000) 2021-08-03T12:32:49.983 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:49.980+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:49.981077+0000) 2021-08-03T12:32:50.167 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:50.163+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:50.164083+0000) 2021-08-03T12:32:50.169 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:50.165+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:50.166052+0000) 2021-08-03T12:32:50.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:50.939+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:50.940707+0000) 2021-08-03T12:32:50.978 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:50.973+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:50.974130+0000) 2021-08-03T12:32:51.168 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:51.164+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:51.164841+0000) 2021-08-03T12:32:51.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:51.940+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:51.940863+0000) 2021-08-03T12:32:52.484 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:32:52.481+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:52.482001+0000) 2021-08-03T12:32:52.943 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:52.940+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:52.941020+0000) 2021-08-03T12:32:53.018 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:53.013+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:53.014259+0000) 2021-08-03T12:32:53.375 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:53.371+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:53.371805+0000) 2021-08-03T12:32:53.427 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:53.100+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7254 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:32:53.742 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:32:53.737+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:53.738269+0000) 2021-08-03T12:32:54.375 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:54.371+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:54.372507+0000) 2021-08-03T12:32:54.493 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:32:54.487+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:54.488528+0000) 2021-08-03T12:32:54.883 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:32:54.879+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:54.879896+0000) 2021-08-03T12:32:54.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:54.962+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:54.963088+0000) 2021-08-03T12:32:55.376 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:55.372+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:55.373317+0000) 2021-08-03T12:32:55.955 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:32:55.950+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:55.951141+0000) 2021-08-03T12:32:55.955 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:55.952+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:55.952883+0000) 2021-08-03T12:32:56.017 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:56.013+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:56.014750+0000) 2021-08-03T12:32:56.136 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:32:56.007+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7218 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:32:56.251 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:56.246+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:56.247467+0000) 2021-08-03T12:32:56.304 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:56.300+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:56.301503+0000) 2021-08-03T12:32:56.378 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:56.374+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:56.374881+0000) 2021-08-03T12:32:56.704 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:32:56.532+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3097 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:32:58.666 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:32:58.660+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:58.661661+0000) 2021-08-03T12:32:58.836 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:58.832+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:58.833518+0000) 2021-08-03T12:32:59.519 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:32:59.514+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:59.515339+0000) 2021-08-03T12:32:59.757 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:32:59.750+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:59.751625+0000) 2021-08-03T12:32:59.835 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:32:59.829+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:32:59.830097+0000) 2021-08-03T12:33:00.002 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:32:59.999+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:00.000041+0000) 2021-08-03T12:33:00.043 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:32:59.854+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7265 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:00.179 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:33:00.175+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:00.176670+0000) 2021-08-03T12:33:00.825 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:00.819+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:00.820698+0000) 2021-08-03T12:33:01.005 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:01.001+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:01.002665+0000) 2021-08-03T12:33:02.007 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:02.004+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:02.004845+0000) 2021-08-03T12:33:02.416 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:02.410+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:02.411041+0000) 2021-08-03T12:33:02.434 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:02.429+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:02.429837+0000) 2021-08-03T12:33:02.560 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:02.557+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:02.558282+0000) 2021-08-03T12:33:03.007 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:03.004+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:03.005045+0000) 2021-08-03T12:33:03.082 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:03.077+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7227 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:03.238 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:03.232+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:03.233057+0000) 2021-08-03T12:33:03.362 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:03.357+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:03.358365+0000) 2021-08-03T12:33:03.695 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:03.691+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:03.692490+0000) 2021-08-03T12:33:03.960 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:03.956+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:03.957407+0000) 2021-08-03T12:33:04.529 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:04.522+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3099 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:04.696 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:04.692+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:04.693054+0000) 2021-08-03T12:33:04.746 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:04.742+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:04.742858+0000) 2021-08-03T12:33:05.351 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:05.345+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:05.346503+0000) 2021-08-03T12:33:05.605 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:05.601+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:05.602260+0000) 2021-08-03T12:33:05.613 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:05.609+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:05.610624+0000) 2021-08-03T12:33:05.696 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:05.692+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:05.693609+0000) 2021-08-03T12:33:06.116 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:05.772+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7278 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:06.614 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:06.610+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:06.611252+0000) 2021-08-03T12:33:06.697 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:06.693+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:06.694193+0000) 2021-08-03T12:33:07.615 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:07.611+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:07.611860+0000) 2021-08-03T12:33:07.698 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:07.694+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:07.694809+0000) 2021-08-03T12:33:08.038 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:08.035+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:08.035828+0000) 2021-08-03T12:33:08.526 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:08.523+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:08.523806+0000) 2021-08-03T12:33:08.567 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:08.563+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:08.564035+0000) 2021-08-03T12:33:08.615 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:08.611+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:08.612481+0000) 2021-08-03T12:33:08.640 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:08.634+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:08.635267+0000) 2021-08-03T12:33:08.698 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:08.694+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:08.695489+0000) 2021-08-03T12:33:09.526 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:09.523+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:09.523980+0000) 2021-08-03T12:33:09.567 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:09.564+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:09.564745+0000) 2021-08-03T12:33:09.616 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:09.612+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:09.613085+0000) 2021-08-03T12:33:09.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:09.686+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:09.686978+0000) 2021-08-03T12:33:09.851 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:09.847+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:09.847865+0000) 2021-08-03T12:33:10.526 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:10.523+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:10.524128+0000) 2021-08-03T12:33:10.568 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:10.564+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:10.565345+0000) 2021-08-03T12:33:10.588 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:10.585+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:10.585819+0000) 2021-08-03T12:33:10.617 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:10.612+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:10.613704+0000) 2021-08-03T12:33:10.840 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:33:10.837+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:10.838047+0000) 2021-08-03T12:33:11.208 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:11.152+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3099 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:11.391 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:11.368+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7246 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:11.526 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:11.523+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:11.524285+0000) 2021-08-03T12:33:11.589 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:11.585+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:11.586435+0000) 2021-08-03T12:33:11.648 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:11.643+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:11.644527+0000) 2021-08-03T12:33:12.318 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:12.313+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:12.313972+0000) 2021-08-03T12:33:12.421 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:12.416+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:12.417344+0000) 2021-08-03T12:33:12.590 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:12.586+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:12.587110+0000) 2021-08-03T12:33:13.024 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:12.981+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7286 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:13.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:13.024+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:13.025225+0000) 2021-08-03T12:33:13.306 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:13.301+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:13.302208+0000) 2021-08-03T12:33:13.442 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:13.436+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:13.437671+0000) 2021-08-03T12:33:13.591 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:13.586+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:13.587691+0000) 2021-08-03T12:33:13.944 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:13.940+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:13.941437+0000) 2021-08-03T12:33:14.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:14.448+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:14.449149+0000) 2021-08-03T12:33:14.767 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:14.762+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:14.763497+0000) 2021-08-03T12:33:14.944 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:14.940+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:14.941588+0000) 2021-08-03T12:33:14.954 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:14.950+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:14.950757+0000) 2021-08-03T12:33:15.297 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:15.293+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:15.294461+0000) 2021-08-03T12:33:15.944 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:15.940+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:15.941728+0000) 2021-08-03T12:33:15.954 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:15.950+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:15.951493+0000) 2021-08-03T12:33:16.944 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:16.941+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:16.941884+0000) 2021-08-03T12:33:16.955 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:16.951+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:16.952309+0000) 2021-08-03T12:33:16.973 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:16.968+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:16.969384+0000) 2021-08-03T12:33:16.988 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:16.816+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7254 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:17.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:17.854+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:17.855534+0000) 2021-08-03T12:33:17.944 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:17.941+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:17.941997+0000) 2021-08-03T12:33:17.956 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:17.952+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:17.953225+0000) 2021-08-03T12:33:18.043 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:18.038+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:18.039042+0000) 2021-08-03T12:33:18.185 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:18.180+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:18.181236+0000) 2021-08-03T12:33:18.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:18.428+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:18.429373+0000) 2021-08-03T12:33:18.785 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:18.780+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:18.780795+0000) 2021-08-03T12:33:18.813 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:18.753+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3099 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:18.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:18.941+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:18.942137+0000) 2021-08-03T12:33:18.957 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:18.953+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:18.954131+0000) 2021-08-03T12:33:19.041 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:19.036+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:19.036845+0000) 2021-08-03T12:33:19.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:19.428+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:19.429509+0000) 2021-08-03T12:33:19.500 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:19.494+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:19.495393+0000) 2021-08-03T12:33:19.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:19.941+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:19.942257+0000) 2021-08-03T12:33:19.958 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:19.954+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:19.954839+0000) 2021-08-03T12:33:20.321 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:20.317+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7325 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:20.378 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:20.375+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:20.375865+0000) 2021-08-03T12:33:20.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:20.428+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:20.429615+0000) 2021-08-03T12:33:20.465 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:33:20.462+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:20.463276+0000) 2021-08-03T12:33:20.959 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:20.954+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:20.955467+0000) 2021-08-03T12:33:21.110 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:21.105+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:21.105770+0000) 2021-08-03T12:33:21.212 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:21.208+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:21.209682+0000) 2021-08-03T12:33:21.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:21.428+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:21.429732+0000) 2021-08-03T12:33:21.959 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:21.955+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:21.956128+0000) 2021-08-03T12:33:22.151 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:22.147+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:22.148373+0000) 2021-08-03T12:33:22.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:22.429+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:22.429883+0000) 2021-08-03T12:33:22.960 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:22.955+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:22.956703+0000) 2021-08-03T12:33:23.187 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:22.845+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7260 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:23.960 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:23.956+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:23.957278+0000) 2021-08-03T12:33:24.008 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:24.004+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:24.005488+0000) 2021-08-03T12:33:24.011 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:24.007+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3099 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:24.807 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:24.802+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:24.803458+0000) 2021-08-03T12:33:24.890 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:24.886+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:24.887002+0000) 2021-08-03T12:33:25.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:25.006+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:25.007915+0000) 2021-08-03T12:33:25.703 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:25.697+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:25.699453+0000) 2021-08-03T12:33:25.891 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:25.886+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:25.887820+0000) 2021-08-03T12:33:26.012 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:26.008+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:26.010100+0000) 2021-08-03T12:33:26.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:26.427+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:26.429480+0000) 2021-08-03T12:33:26.458 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:26.452+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:26.453968+0000) 2021-08-03T12:33:26.891 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:26.886+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:26.888425+0000) 2021-08-03T12:33:27.012 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:27.008+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:27.010301+0000) 2021-08-03T12:33:27.384 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:27.378+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:27.380589+0000) 2021-08-03T12:33:27.892 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:27.887+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:27.889015+0000) 2021-08-03T12:33:27.929 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:27.924+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:27.926200+0000) 2021-08-03T12:33:28.013 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:28.008+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:28.010448+0000) 2021-08-03T12:33:28.893 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:28.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:28.889847+0000) 2021-08-03T12:33:28.930 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:28.925+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:28.926878+0000) 2021-08-03T12:33:29.013 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:29.008+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:29.010674+0000) 2021-08-03T12:33:29.109 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:29.022+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3100 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:29.111 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:28.965+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7341 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:29.893 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:29.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:29.890630+0000) 2021-08-03T12:33:29.930 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:29.925+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:29.927507+0000) 2021-08-03T12:33:29.962 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:29.957+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7280 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:30.033 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:33:30.028+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:30.030571+0000) 2021-08-03T12:33:30.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:30.048+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:30.050131+0000) 2021-08-03T12:33:30.210 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:30.203+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:30.205375+0000) 2021-08-03T12:33:30.895 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:30.889+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:30.891214+0000) 2021-08-03T12:33:30.932 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:30.926+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:30.928054+0000) 2021-08-03T12:33:31.714 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:31.708+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:31.710357+0000) 2021-08-03T12:33:31.895 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:31.890+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:31.891806+0000) 2021-08-03T12:33:31.931 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:31.926+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:31.928638+0000) 2021-08-03T12:33:32.661 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:32.656+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:32.658680+0000) 2021-08-03T12:33:32.895 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:32.891+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:32.892420+0000) 2021-08-03T12:33:32.918 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:32.912+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:32.914272+0000) 2021-08-03T12:33:32.932 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:32.928+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:32.929191+0000) 2021-08-03T12:33:33.896 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:33.892+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:33.893061+0000) 2021-08-03T12:33:33.932 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:33.928+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:33.929738+0000) 2021-08-03T12:33:34.237 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:34.232+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:34.232865+0000) 2021-08-03T12:33:34.897 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:34.893+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:34.893893+0000) 2021-08-03T12:33:34.933 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:34.929+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:34.930303+0000) 2021-08-03T12:33:35.188 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:35.148+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7349 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:35.898 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:35.894+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:35.894885+0000) 2021-08-03T12:33:35.909 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:35.904+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:35.905724+0000) 2021-08-03T12:33:36.610 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:36.605+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3100 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:36.898 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:36.894+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:36.895447+0000) 2021-08-03T12:33:37.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:37.335+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:37.336655+0000) 2021-08-03T12:33:37.602 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:37.577+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7293 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:37.899 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:37.895+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:37.895991+0000) 2021-08-03T12:33:38.900 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:38.895+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:38.896562+0000) 2021-08-03T12:33:39.044 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:39.041+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:39.042266+0000) 2021-08-03T12:33:39.901 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:39.896+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:39.897412+0000) 2021-08-03T12:33:40.677 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:40.671+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:40.672772+0000) 2021-08-03T12:33:40.678 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:40.673+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:40.674575+0000) 2021-08-03T12:33:40.901 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:40.897+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:40.898187+0000) 2021-08-03T12:33:40.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:40.941+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:40.942714+0000) 2021-08-03T12:33:41.574 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:41.570+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:41.570988+0000) 2021-08-03T12:33:41.902 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:41.898+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:41.898766+0000) 2021-08-03T12:33:41.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:41.942+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:41.942809+0000) 2021-08-03T12:33:42.080 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:42.077+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:42.078151+0000) 2021-08-03T12:33:42.522 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:42.518+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:42.518788+0000) 2021-08-03T12:33:42.575 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:42.571+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:42.572205+0000) 2021-08-03T12:33:42.786 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:42.172+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7349 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:42.870 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:42.864+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:42.865600+0000) 2021-08-03T12:33:42.902 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:42.898+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:42.899570+0000) 2021-08-03T12:33:42.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:42.942+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:42.942982+0000) 2021-08-03T12:33:43.437 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:33:43.433+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:43.434586+0000) 2021-08-03T12:33:43.523 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:43.519+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:43.520075+0000) 2021-08-03T12:33:43.576 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:43.572+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:43.572819+0000) 2021-08-03T12:33:43.903 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:43.899+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:43.900348+0000) 2021-08-03T12:33:43.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:43.942+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:43.943114+0000) 2021-08-03T12:33:44.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:44.124+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:44.125396+0000) 2021-08-03T12:33:44.524 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:44.520+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:44.521173+0000) 2021-08-03T12:33:44.576 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:44.572+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:44.573397+0000) 2021-08-03T12:33:44.739 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:44.734+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:44.734970+0000) 2021-08-03T12:33:44.904 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:44.900+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:44.900923+0000) 2021-08-03T12:33:44.945 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:44.942+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:44.943243+0000) 2021-08-03T12:33:44.977 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:44.651+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3100 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:45.525 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:45.521+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:45.522357+0000) 2021-08-03T12:33:45.578 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:45.573+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:45.574010+0000) 2021-08-03T12:33:45.905 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:45.900+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:45.901602+0000) 2021-08-03T12:33:45.946 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:45.942+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:45.943398+0000) 2021-08-03T12:33:46.527 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:46.522+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:46.523431+0000) 2021-08-03T12:33:46.578 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:46.574+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:46.575402+0000) 2021-08-03T12:33:46.689 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:46.684+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:46.684981+0000) 2021-08-03T12:33:46.905 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:46.901+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:46.902162+0000) 2021-08-03T12:33:46.946 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:46.942+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:46.943528+0000) 2021-08-03T12:33:47.455 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:47.108+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7315 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:47.528 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:47.523+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:47.524573+0000) 2021-08-03T12:33:47.752 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:47.748+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:47.748966+0000) 2021-08-03T12:33:47.906 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:47.901+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:47.902730+0000) 2021-08-03T12:33:48.014 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:48.009+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7349 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:48.356 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:48.352+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:48.353710+0000) 2021-08-03T12:33:48.528 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:48.524+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:48.525478+0000) 2021-08-03T12:33:48.753 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:48.748+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:48.749724+0000) 2021-08-03T12:33:48.906 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:48.902+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:48.903319+0000) 2021-08-03T12:33:49.171 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:49.165+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:49.166284+0000) 2021-08-03T12:33:49.272 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:49.267+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:49.268668+0000) 2021-08-03T12:33:49.369 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:49.366+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:49.367283+0000) 2021-08-03T12:33:49.529 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:49.525+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:49.526390+0000) 2021-08-03T12:33:49.753 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:49.749+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:49.750315+0000) 2021-08-03T12:33:49.907 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:49.903+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:49.903904+0000) 2021-08-03T12:33:50.013 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:50.010+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:50.011076+0000) 2021-08-03T12:33:50.188 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:50.183+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:50.184696+0000) 2021-08-03T12:33:50.273 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:50.268+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:50.269650+0000) 2021-08-03T12:33:50.530 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:50.526+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:50.527307+0000) 2021-08-03T12:33:50.754 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:50.750+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:50.750902+0000) 2021-08-03T12:33:50.907 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:50.903+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:50.904483+0000) 2021-08-03T12:33:51.018 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:51.014+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:51.015457+0000) 2021-08-03T12:33:51.274 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:51.269+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:51.270407+0000) 2021-08-03T12:33:51.432 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:51.428+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:51.428757+0000) 2021-08-03T12:33:51.533 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:51.529+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:51.529014+0000) 2021-08-03T12:33:51.676 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:51.671+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3101 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:51.755 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:51.750+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:51.751450+0000) 2021-08-03T12:33:51.908 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:51.904+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:51.905063+0000) 2021-08-03T12:33:52.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:52.016+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:52.017681+0000) 2021-08-03T12:33:52.274 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:52.270+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:52.271189+0000) 2021-08-03T12:33:52.536 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:52.530+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:52.531119+0000) 2021-08-03T12:33:52.756 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:52.751+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:52.752373+0000) 2021-08-03T12:33:52.908 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:52.904+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:52.905673+0000) 2021-08-03T12:33:53.020 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:53.017+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:53.017876+0000) 2021-08-03T12:33:53.203 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:53.199+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:53.199892+0000) 2021-08-03T12:33:53.275 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:53.271+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:53.272011+0000) 2021-08-03T12:33:53.319 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:53.315+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:53.316393+0000) 2021-08-03T12:33:53.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:53.429+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:53.430259+0000) 2021-08-03T12:33:53.756 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:53.752+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:53.752926+0000) 2021-08-03T12:33:53.909 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:53.905+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:53.906255+0000) 2021-08-03T12:33:54.020 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:54.017+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:54.018024+0000) 2021-08-03T12:33:54.145 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:54.142+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:54.142946+0000) 2021-08-03T12:33:54.154 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:33:54.151+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:54.152375+0000) 2021-08-03T12:33:54.204 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:54.199+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:54.200597+0000) 2021-08-03T12:33:54.276 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:54.272+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:54.272816+0000) 2021-08-03T12:33:54.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:54.429+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:54.430381+0000) 2021-08-03T12:33:54.707 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:33:54.703+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7376 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:33:54.912 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:54.906+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:54.906813+0000) 2021-08-03T12:33:55.159 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:33:54.897+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7325 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:33:55.204 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:55.200+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:55.201221+0000) 2021-08-03T12:33:55.265 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:33:55.259+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:55.260759+0000) 2021-08-03T12:33:55.277 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:33:55.272+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:55.273647+0000) 2021-08-03T12:33:55.289 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:33:55.285+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:55.286025+0000) 2021-08-03T12:33:55.706 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:33:55.701+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:55.702106+0000) 2021-08-03T12:33:56.205 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:56.201+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:56.201807+0000) 2021-08-03T12:33:56.533 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:56.528+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:56.529474+0000) 2021-08-03T12:33:57.206 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:57.201+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:57.202406+0000) 2021-08-03T12:33:57.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:57.416+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:57.417084+0000) 2021-08-03T12:33:57.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:33:57.913+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:57.914137+0000) 2021-08-03T12:33:58.206 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:58.202+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:58.203017+0000) 2021-08-03T12:33:58.388 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:58.383+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:58.384508+0000) 2021-08-03T12:33:58.588 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:33:58.583+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:58.583961+0000) 2021-08-03T12:33:58.649 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:33:58.476+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3101 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:33:59.207 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:33:59.203+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:59.203932+0000) 2021-08-03T12:33:59.389 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:33:59.384+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:59.385599+0000) 2021-08-03T12:33:59.412 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:33:59.408+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:33:59.409678+0000) 2021-08-03T12:34:00.207 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:00.203+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:00.204494+0000) 2021-08-03T12:34:00.390 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:00.385+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:00.386429+0000) 2021-08-03T12:34:00.413 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:00.409+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:00.410314+0000) 2021-08-03T12:34:01.208 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:01.204+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:01.205056+0000) 2021-08-03T12:34:01.390 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:01.386+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:01.387247+0000) 2021-08-03T12:34:01.412 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:00.750+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7384 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:01.414 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:01.410+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:01.411031+0000) 2021-08-03T12:34:01.689 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:01.683+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:01.684285+0000) 2021-08-03T12:34:01.716 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:01.711+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7332 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:01.798 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:01.795+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:01.796125+0000) 2021-08-03T12:34:02.140 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:02.135+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:02.136033+0000) 2021-08-03T12:34:02.391 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:02.387+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:02.387852+0000) 2021-08-03T12:34:02.527 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:02.524+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:02.524861+0000) 2021-08-03T12:34:03.062 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:34:03.057+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:03.058743+0000) 2021-08-03T12:34:03.391 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:03.387+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:03.388367+0000) 2021-08-03T12:34:03.527 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:03.524+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:03.524996+0000) 2021-08-03T12:34:03.847 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:03.842+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:03.843644+0000) 2021-08-03T12:34:04.049 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:04.045+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:04.046686+0000) 2021-08-03T12:34:04.392 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:04.388+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:04.389227+0000) 2021-08-03T12:34:04.527 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:04.524+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:04.525093+0000) 2021-08-03T12:34:04.728 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:04.723+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:04.724572+0000) 2021-08-03T12:34:05.074 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:05.069+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:05.069993+0000) 2021-08-03T12:34:05.393 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:05.389+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:05.390359+0000) 2021-08-03T12:34:05.528 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:05.524+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:05.525267+0000) 2021-08-03T12:34:06.394 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:06.390+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:06.391189+0000) 2021-08-03T12:34:06.528 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:06.524+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:06.525415+0000) 2021-08-03T12:34:07.384 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:07.128+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7355 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:07.395 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:07.391+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:07.392018+0000) 2021-08-03T12:34:07.880 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:07.876+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7386 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:08.396 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:08.392+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:08.392867+0000) 2021-08-03T12:34:09.159 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:09.012+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3103 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:09.168 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:09.164+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:09.165584+0000) 2021-08-03T12:34:09.397 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:09.393+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:09.393875+0000) 2021-08-03T12:34:10.170 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:10.165+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:10.166684+0000) 2021-08-03T12:34:10.397 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:10.393+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:10.394477+0000) 2021-08-03T12:34:10.670 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:10.666+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:10.667549+0000) 2021-08-03T12:34:10.693 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:10.688+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:10.689378+0000) 2021-08-03T12:34:10.761 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:10.756+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:10.756922+0000) 2021-08-03T12:34:10.995 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:10.991+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:10.992416+0000) 2021-08-03T12:34:11.010 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:11.005+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:11.006068+0000) 2021-08-03T12:34:11.037 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:11.034+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:11.034993+0000) 2021-08-03T12:34:11.171 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:11.166+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:11.167492+0000) 2021-08-03T12:34:11.662 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:34:11.658+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:11.659675+0000) 2021-08-03T12:34:11.917 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:11.911+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:11.912353+0000) 2021-08-03T12:34:11.919 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:11.914+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:11.915228+0000) 2021-08-03T12:34:12.171 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:12.167+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:12.168166+0000) 2021-08-03T12:34:12.363 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:12.358+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:12.358879+0000) 2021-08-03T12:34:12.539 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:12.533+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:12.535571+0000) 2021-08-03T12:34:13.172 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:13.167+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:13.168786+0000) 2021-08-03T12:34:13.539 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:13.534+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:13.536096+0000) 2021-08-03T12:34:13.800 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:34:13.796+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:13.796871+0000) 2021-08-03T12:34:13.906 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:13.899+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7386 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:14.035 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:13.793+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7364 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:14.172 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:14.168+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:14.169376+0000) 2021-08-03T12:34:14.989 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:14.983+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3103 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:15.021 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:15.016+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:15.018530+0000) 2021-08-03T12:34:15.357 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:15.351+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:15.353480+0000) 2021-08-03T12:34:15.430 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:15.425+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:15.427624+0000) 2021-08-03T12:34:15.978 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:15.973+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:15.975642+0000) 2021-08-03T12:34:16.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:16.020+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:16.021972+0000) 2021-08-03T12:34:16.220 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:16.216+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:16.218067+0000) 2021-08-03T12:34:17.026 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:17.022+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:17.024005+0000) 2021-08-03T12:34:17.582 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:17.577+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:17.579048+0000) 2021-08-03T12:34:17.801 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:34:17.797+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:17.798441+0000) 2021-08-03T12:34:17.993 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:17.987+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:17.989136+0000) 2021-08-03T12:34:18.583 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:18.578+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:18.579780+0000) 2021-08-03T12:34:18.661 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:18.655+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:18.656703+0000) 2021-08-03T12:34:19.915 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:19.871+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7386 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:19.918 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:19.912+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:19.913452+0000) 2021-08-03T12:34:19.923 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:19.917+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:19.919304+0000) 2021-08-03T12:34:20.089 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:19.891+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7379 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:20.194 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:20.183+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3109 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:20.513 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:20.509+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:20.511061+0000) 2021-08-03T12:34:21.928 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:21.924+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:21.925578+0000) 2021-08-03T12:34:22.612 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:22.605+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:22.606601+0000) 2021-08-03T12:34:22.929 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:22.925+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:22.926306+0000) 2021-08-03T12:34:23.930 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:23.926+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:23.927008+0000) 2021-08-03T12:34:24.761 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:24.755+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:24.756624+0000) 2021-08-03T12:34:24.931 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:24.926+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:24.927591+0000) 2021-08-03T12:34:25.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:25.129+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:25.130203+0000) 2021-08-03T12:34:25.435 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:25.405+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3111 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:25.882 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:25.824+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7386 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:25.885 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:34:25.880+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:25.881385+0000) 2021-08-03T12:34:25.918 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:25.915+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:25.916238+0000) 2021-08-03T12:34:25.931 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:25.927+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:25.928578+0000) 2021-08-03T12:34:26.932 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:26.928+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:26.929175+0000) 2021-08-03T12:34:27.234 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:27.229+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7399 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:27.588 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:27.582+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:27.582764+0000) 2021-08-03T12:34:27.933 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:27.928+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:27.929767+0000) 2021-08-03T12:34:28.159 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:28.154+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:28.154938+0000) 2021-08-03T12:34:28.933 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:28.929+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:28.930373+0000) 2021-08-03T12:34:29.245 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:29.241+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:29.241793+0000) 2021-08-03T12:34:29.283 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:34:29.280+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:29.281279+0000) 2021-08-03T12:34:29.535 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:29.531+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:29.532455+0000) 2021-08-03T12:34:29.620 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:29.616+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:29.617321+0000) 2021-08-03T12:34:29.932 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:29.928+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:29.929595+0000) 2021-08-03T12:34:29.934 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:29.930+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:29.930933+0000) 2021-08-03T12:34:30.015 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:30.009+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:30.010418+0000) 2021-08-03T12:34:30.497 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:30.489+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:30.489865+0000) 2021-08-03T12:34:30.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:30.575+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:30.576731+0000) 2021-08-03T12:34:30.621 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:30.617+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:30.618047+0000) 2021-08-03T12:34:30.935 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:30.930+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:30.931485+0000) 2021-08-03T12:34:31.086 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:31.081+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:31.082071+0000) 2021-08-03T12:34:31.402 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:31.398+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:31.399012+0000) 2021-08-03T12:34:31.622 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:31.618+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:31.618877+0000) 2021-08-03T12:34:31.935 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:31.930+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:31.932082+0000) 2021-08-03T12:34:32.215 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:32.210+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:32.210973+0000) 2021-08-03T12:34:32.399 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:32.350+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:32.402 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:32.397+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:32.399635+0000) 2021-08-03T12:34:32.622 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:32.617+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:32.619504+0000) 2021-08-03T12:34:32.936 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:32.931+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:32.933049+0000) 2021-08-03T12:34:33.215 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:33.210+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:33.211657+0000) 2021-08-03T12:34:33.250 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:33.245+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3124 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:33.490 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:33.486+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:33.487565+0000) 2021-08-03T12:34:33.624 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:33.618+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:33.620664+0000) 2021-08-03T12:34:33.754 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:33.749+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:33.749750+0000) 2021-08-03T12:34:33.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:33.752+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:33.753350+0000) 2021-08-03T12:34:33.787 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:33.745+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7407 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:33.937 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:33.931+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:33.933608+0000) 2021-08-03T12:34:34.215 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:34.211+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:34.212178+0000) 2021-08-03T12:34:34.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:34.244+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:34.245282+0000) 2021-08-03T12:34:34.271 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:34:34.264+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:34.266138+0000) 2021-08-03T12:34:34.937 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:34.932+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:34.934157+0000) 2021-08-03T12:34:35.938 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:35.932+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:35.934716+0000) 2021-08-03T12:34:36.385 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:36.380+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:36.381660+0000) 2021-08-03T12:34:36.416 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:36.409+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:36.410022+0000) 2021-08-03T12:34:36.939 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:36.933+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:36.935335+0000) 2021-08-03T12:34:37.528 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:37.525+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:37.525862+0000) 2021-08-03T12:34:37.789 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:37.783+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:37.785053+0000) 2021-08-03T12:34:37.843 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:37.806+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7388 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:37.939 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:37.934+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:37.936414+0000) 2021-08-03T12:34:38.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:38.023+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:38.024401+0000) 2021-08-03T12:34:38.528 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:38.525+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:38.526007+0000) 2021-08-03T12:34:38.550 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:38.544+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:38.546536+0000) 2021-08-03T12:34:38.931 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:38.925+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:38.926574+0000) 2021-08-03T12:34:38.940 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:38.935+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:38.936970+0000) 2021-08-03T12:34:39.031 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:39.027+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:39.028422+0000) 2021-08-03T12:34:39.499 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:39.277+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3124 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:39.528 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:39.525+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:39.526166+0000) 2021-08-03T12:34:39.941 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:39.936+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:39.937523+0000) 2021-08-03T12:34:40.034 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:40.030+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:40.031646+0000) 2021-08-03T12:34:40.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:40.525+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:40.526310+0000) 2021-08-03T12:34:40.941 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:40.937+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:40.938080+0000) 2021-08-03T12:34:41.038 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:41.034+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:41.035311+0000) 2021-08-03T12:34:41.515 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:34:41.512+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:41.513157+0000) 2021-08-03T12:34:41.523 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:41.507+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7423 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:41.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:41.525+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:41.526433+0000) 2021-08-03T12:34:41.629 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:34:41.625+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:41.626075+0000) 2021-08-03T12:34:41.942 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:41.937+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:41.938671+0000) 2021-08-03T12:34:42.303 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:42.299+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:42.300197+0000) 2021-08-03T12:34:42.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:42.537+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:42.538594+0000) 2021-08-03T12:34:42.942 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:42.938+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:42.939351+0000) 2021-08-03T12:34:43.576 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:43.572+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:43.572877+0000) 2021-08-03T12:34:43.682 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:43.580+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7390 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:43.799 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:43.795+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:43.796301+0000) 2021-08-03T12:34:43.820 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:43.814+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:43.815430+0000) 2021-08-03T12:34:44.059 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:44.054+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:44.055119+0000) 2021-08-03T12:34:44.301 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:34:44.296+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:44.296942+0000) 2021-08-03T12:34:44.770 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:34:44.765+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:44.766679+0000) 2021-08-03T12:34:45.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:45.069+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:45.069916+0000) 2021-08-03T12:34:45.225 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:45.220+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:45.221107+0000) 2021-08-03T12:34:45.981 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:45.976+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:45.977674+0000) 2021-08-03T12:34:46.412 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:46.367+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3124 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:47.185 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:47.180+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:47.180835+0000) 2021-08-03T12:34:47.544 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:47.540+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:47.540882+0000) 2021-08-03T12:34:48.585 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:48.561+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:48.562484+0000) 2021-08-03T12:34:49.586 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:49.581+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:49.582371+0000) 2021-08-03T12:34:49.586 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:49.582+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:49.583097+0000) 2021-08-03T12:34:49.935 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:49.839+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7425 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:50.216 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:50.175+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7406 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:50.326 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:34:50.322+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:50.323753+0000) 2021-08-03T12:34:50.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:50.786+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:50.787584+0000) 2021-08-03T12:34:50.905 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:50.900+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:50.901701+0000) 2021-08-03T12:34:51.179 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:51.175+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:51.176403+0000) 2021-08-03T12:34:52.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:52.694+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:52.695792+0000) 2021-08-03T12:34:52.926 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:52.919+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:52.920562+0000) 2021-08-03T12:34:54.297 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:34:54.264+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3124 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:34:54.500 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:54.495+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:54.496204+0000) 2021-08-03T12:34:54.628 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:54.623+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:54.624628+0000) 2021-08-03T12:34:54.737 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:34:54.731+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:54.732474+0000) 2021-08-03T12:34:55.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:55.430+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:55.431085+0000) 2021-08-03T12:34:55.629 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:55.624+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:55.625652+0000) 2021-08-03T12:34:55.744 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:34:55.739+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:55.740153+0000) 2021-08-03T12:34:55.868 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:34:55.863+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:55.864671+0000) 2021-08-03T12:34:55.872 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:34:55.867+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7423 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:34:56.372 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:56.366+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:56.367337+0000) 2021-08-03T12:34:56.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:56.430+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:56.431238+0000) 2021-08-03T12:34:56.519 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:34:56.469+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7427 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:34:56.629 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:56.625+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:56.626457+0000) 2021-08-03T12:34:57.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:57.430+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:57.431404+0000) 2021-08-03T12:34:57.630 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:57.626+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:57.626914+0000) 2021-08-03T12:34:58.075 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:58.071+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:58.072483+0000) 2021-08-03T12:34:58.111 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:34:58.106+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:58.107229+0000) 2021-08-03T12:34:58.272 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:34:58.267+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:58.268041+0000) 2021-08-03T12:34:58.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:58.430+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:58.431557+0000) 2021-08-03T12:34:58.630 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:58.626+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:58.627504+0000) 2021-08-03T12:34:59.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:59.429+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:59.431685+0000) 2021-08-03T12:34:59.602 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:34:59.597+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:59.599547+0000) 2021-08-03T12:34:59.631 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:34:59.627+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:59.628166+0000) 2021-08-03T12:34:59.691 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:34:59.686+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:34:59.687118+0000) 2021-08-03T12:35:00.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:00.430+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:00.431812+0000) 2021-08-03T12:35:00.632 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:00.628+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:00.628807+0000) 2021-08-03T12:35:00.827 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:00.822+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:00.822913+0000) 2021-08-03T12:35:00.979 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:35:00.973+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:00.975518+0000) 2021-08-03T12:35:01.035 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:01.030+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:01.032202+0000) 2021-08-03T12:35:01.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:01.430+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:01.431973+0000) 2021-08-03T12:35:01.632 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:01.628+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:01.629395+0000) 2021-08-03T12:35:02.037 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:02.032+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:02.034786+0000) 2021-08-03T12:35:02.308 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:02.302+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:02.303121+0000) 2021-08-03T12:35:02.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:02.430+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:02.432120+0000) 2021-08-03T12:35:02.560 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:02.490+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7438 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:02.633 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:02.629+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:02.629987+0000) 2021-08-03T12:35:02.694 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:02.538+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7445 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:02.822 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:02.816+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3126 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:03.350 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:03.345+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:03.346482+0000) 2021-08-03T12:35:03.490 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:03.486+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:03.488220+0000) 2021-08-03T12:35:03.634 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:03.629+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:03.630606+0000) 2021-08-03T12:35:03.907 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:03.902+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:03.904149+0000) 2021-08-03T12:35:04.551 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:04.546+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:04.548664+0000) 2021-08-03T12:35:04.555 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:04.549+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:04.551223+0000) 2021-08-03T12:35:04.600 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:04.596+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:04.596876+0000) 2021-08-03T12:35:04.634 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:04.630+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:04.631141+0000) 2021-08-03T12:35:04.958 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:04.952+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:04.954649+0000) 2021-08-03T12:35:05.635 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:05.631+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:05.632216+0000) 2021-08-03T12:35:05.699 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:05.694+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:05.695529+0000) 2021-08-03T12:35:06.636 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:06.632+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:06.632833+0000) 2021-08-03T12:35:07.636 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:07.632+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:07.633444+0000) 2021-08-03T12:35:07.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:07.942+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:07.944426+0000) 2021-08-03T12:35:08.051 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:35:08.047+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:08.047827+0000) 2021-08-03T12:35:08.519 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:35:08.514+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:08.515624+0000) 2021-08-03T12:35:08.637 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:08.633+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:08.634005+0000) 2021-08-03T12:35:08.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:08.943+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:08.944604+0000) 2021-08-03T12:35:09.638 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:09.633+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:09.634579+0000) 2021-08-03T12:35:09.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:09.943+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:09.944751+0000) 2021-08-03T12:35:10.026 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:10.023+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:10.023937+0000) 2021-08-03T12:35:10.400 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:10.174+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3126 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:10.638 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:10.634+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:10.635516+0000) 2021-08-03T12:35:10.744 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:10.719+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7449 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:10.819 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:10.748+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7465 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:10.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:10.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:10.944867+0000) 2021-08-03T12:35:10.961 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:10.957+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:10.957865+0000) 2021-08-03T12:35:11.026 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:11.023+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:11.024069+0000) 2021-08-03T12:35:11.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:11.043+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:11.043899+0000) 2021-08-03T12:35:11.050 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:11.044+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:11.045622+0000) 2021-08-03T12:35:11.394 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:11.389+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:11.390796+0000) 2021-08-03T12:35:11.639 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:11.635+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:11.636145+0000) 2021-08-03T12:35:11.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:11.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:11.945006+0000) 2021-08-03T12:35:12.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:12.023+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:12.024192+0000) 2021-08-03T12:35:12.347 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:12.342+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:12.343194+0000) 2021-08-03T12:35:12.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:12.526+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:12.526839+0000) 2021-08-03T12:35:12.633 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:12.629+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:12.630504+0000) 2021-08-03T12:35:12.640 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:12.635+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:12.636589+0000) 2021-08-03T12:35:12.833 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:12.828+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:12.829655+0000) 2021-08-03T12:35:12.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:12.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:12.945157+0000) 2021-08-03T12:35:13.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:13.023+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:13.024332+0000) 2021-08-03T12:35:13.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:13.526+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:13.526987+0000) 2021-08-03T12:35:13.635 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:13.630+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:13.631553+0000) 2021-08-03T12:35:13.640 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:13.636+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:13.637177+0000) 2021-08-03T12:35:13.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:13.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:13.945298+0000) 2021-08-03T12:35:14.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:14.023+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:14.024461+0000) 2021-08-03T12:35:14.471 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:14.466+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:14.467667+0000) 2021-08-03T12:35:14.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:14.526+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:14.527119+0000) 2021-08-03T12:35:14.635 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:14.631+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:14.632227+0000) 2021-08-03T12:35:14.641 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:14.637+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:14.637761+0000) 2021-08-03T12:35:14.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:14.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:14.945425+0000) 2021-08-03T12:35:15.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:15.023+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:15.024625+0000) 2021-08-03T12:35:15.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:15.526+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:15.527259+0000) 2021-08-03T12:35:15.636 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:15.632+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:15.632821+0000) 2021-08-03T12:35:15.642 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:15.638+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:15.639721+0000) 2021-08-03T12:35:15.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:15.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:15.945573+0000) 2021-08-03T12:35:16.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:16.023+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:16.024767+0000) 2021-08-03T12:35:16.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:16.526+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:16.527384+0000) 2021-08-03T12:35:16.636 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:16.632+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:16.633475+0000) 2021-08-03T12:35:16.643 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:16.639+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:16.640522+0000) 2021-08-03T12:35:16.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:16.944+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:16.945703+0000) 2021-08-03T12:35:17.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:17.024+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:17.024910+0000) 2021-08-03T12:35:17.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:17.054+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7463 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:17.234 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:17.156+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7482 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:17.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:17.526+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:17.527527+0000) 2021-08-03T12:35:17.645 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:17.641+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:17.641851+0000) 2021-08-03T12:35:17.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:17.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:17.945847+0000) 2021-08-03T12:35:18.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:18.024+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:18.025039+0000) 2021-08-03T12:35:18.033 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:18.028+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:18.029106+0000) 2021-08-03T12:35:18.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:18.526+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:18.527671+0000) 2021-08-03T12:35:18.646 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:18.642+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:18.642839+0000) 2021-08-03T12:35:18.754 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:18.057+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3126 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:18.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:18.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:18.946003+0000) 2021-08-03T12:35:19.027 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:19.024+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:19.025176+0000) 2021-08-03T12:35:19.341 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:19.337+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:19.338629+0000) 2021-08-03T12:35:19.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:19.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:19.527805+0000) 2021-08-03T12:35:19.647 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:19.642+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:19.643616+0000) 2021-08-03T12:35:19.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:19.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:19.946098+0000) 2021-08-03T12:35:20.028 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:20.024+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:20.025295+0000) 2021-08-03T12:35:20.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:20.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:20.527961+0000) 2021-08-03T12:35:20.592 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:20.588+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:20.588889+0000) 2021-08-03T12:35:20.593 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:20.589+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:20.590435+0000) 2021-08-03T12:35:20.647 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:20.643+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:20.644234+0000) 2021-08-03T12:35:20.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:20.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:20.946198+0000) 2021-08-03T12:35:21.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:21.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:21.528071+0000) 2021-08-03T12:35:21.593 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:21.588+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:21.589598+0000) 2021-08-03T12:35:21.594 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:21.590+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:21.591127+0000) 2021-08-03T12:35:21.648 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:21.644+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:21.644805+0000) 2021-08-03T12:35:21.772 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:21.767+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:21.767877+0000) 2021-08-03T12:35:21.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:21.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:21.946356+0000) 2021-08-03T12:35:22.323 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:22.318+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:22.319071+0000) 2021-08-03T12:35:22.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:22.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:22.528184+0000) 2021-08-03T12:35:22.594 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:22.589+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:22.590221+0000) 2021-08-03T12:35:22.595 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:22.591+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:22.592050+0000) 2021-08-03T12:35:22.649 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:22.644+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:22.645735+0000) 2021-08-03T12:35:22.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:22.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:22.946484+0000) 2021-08-03T12:35:23.040 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:23.036+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:23.037503+0000) 2021-08-03T12:35:23.415 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:23.411+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:23.412231+0000) 2021-08-03T12:35:23.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:23.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:23.528354+0000) 2021-08-03T12:35:23.594 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:23.590+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:23.591029+0000) 2021-08-03T12:35:23.595 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:23.591+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:23.592621+0000) 2021-08-03T12:35:23.649 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:23.645+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:23.646330+0000) 2021-08-03T12:35:23.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:23.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:23.946643+0000) 2021-08-03T12:35:24.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:24.039+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.040165+0000) 2021-08-03T12:35:24.416 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:24.412+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.412970+0000) 2021-08-03T12:35:24.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:24.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.528462+0000) 2021-08-03T12:35:24.595 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:24.591+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.591816+0000) 2021-08-03T12:35:24.596 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:24.592+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.593193+0000) 2021-08-03T12:35:24.650 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:24.646+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.646878+0000) 2021-08-03T12:35:24.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:24.945+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.946775+0000) 2021-08-03T12:35:24.976 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:24.972+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:24.973679+0000) 2021-08-03T12:35:25.045 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:25.041+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:25.042486+0000) 2021-08-03T12:35:25.417 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:25.413+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:25.413800+0000) 2021-08-03T12:35:25.529 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:25.524+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7471 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:25.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:25.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:25.528609+0000) 2021-08-03T12:35:25.595 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:25.591+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:25.592496+0000) 2021-08-03T12:35:25.597 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:25.593+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:25.593803+0000) 2021-08-03T12:35:25.611 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:25.603+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3133 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:25.651 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:25.647+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:25.647847+0000) 2021-08-03T12:35:25.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:25.946+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:25.946913+0000) 2021-08-03T12:35:26.045 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:26.041+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:26.042611+0000) 2021-08-03T12:35:26.312 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:26.138+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7491 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:26.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:26.527+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:26.528740+0000) 2021-08-03T12:35:26.596 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:26.592+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:26.593188+0000) 2021-08-03T12:35:26.651 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:26.647+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:26.648437+0000) 2021-08-03T12:35:26.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:26.946+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:26.947036+0000) 2021-08-03T12:35:27.045 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:27.042+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:27.042839+0000) 2021-08-03T12:35:27.147 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:27.143+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:27.144111+0000) 2021-08-03T12:35:27.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:27.528+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:27.528875+0000) 2021-08-03T12:35:27.597 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:27.593+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:27.593838+0000) 2021-08-03T12:35:27.954 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:27.946+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:27.947151+0000) 2021-08-03T12:35:28.045 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:28.042+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:28.042995+0000) 2021-08-03T12:35:28.148 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:28.144+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:28.144837+0000) 2021-08-03T12:35:28.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:28.528+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:28.529019+0000) 2021-08-03T12:35:28.597 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:28.593+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:28.594442+0000) 2021-08-03T12:35:29.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:29.042+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:29.043201+0000) 2021-08-03T12:35:29.148 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:29.144+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:29.145441+0000) 2021-08-03T12:35:29.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:29.528+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:29.529140+0000) 2021-08-03T12:35:29.599 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:29.594+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:29.595389+0000) 2021-08-03T12:35:30.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:30.042+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:30.043357+0000) 2021-08-03T12:35:30.149 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:30.145+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:30.146039+0000) 2021-08-03T12:35:30.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:30.528+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:30.529282+0000) 2021-08-03T12:35:30.600 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:30.595+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:30.596035+0000) 2021-08-03T12:35:30.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:30.793+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:30.794587+0000) 2021-08-03T12:35:31.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:31.042+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:31.043541+0000) 2021-08-03T12:35:31.150 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:31.145+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:31.146701+0000) 2021-08-03T12:35:31.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:31.528+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:31.529439+0000) 2021-08-03T12:35:31.600 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:31.596+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:31.597035+0000) 2021-08-03T12:35:32.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:32.042+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:32.043666+0000) 2021-08-03T12:35:32.150 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:32.146+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:32.147329+0000) 2021-08-03T12:35:32.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:32.528+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:32.529579+0000) 2021-08-03T12:35:32.601 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:32.597+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:32.597864+0000) 2021-08-03T12:35:33.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:33.043+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:33.043868+0000) 2021-08-03T12:35:33.108 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:32.307+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3140 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:33.151 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:33.147+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:33.147922+0000) 2021-08-03T12:35:33.435 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:33.431+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:33.432525+0000) 2021-08-03T12:35:33.483 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:32.979+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7497 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:33.530 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:33.524+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:33.525625+0000) 2021-08-03T12:35:33.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:33.528+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:33.529739+0000) 2021-08-03T12:35:33.601 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:33.597+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:33.598442+0000) 2021-08-03T12:35:33.936 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:33.674+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7471 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:34.152 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:34.147+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:34.148532+0000) 2021-08-03T12:35:34.435 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:34.431+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:34.432676+0000) 2021-08-03T12:35:34.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:34.529+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:34.529884+0000) 2021-08-03T12:35:34.552 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:35:34.548+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:34.549010+0000) 2021-08-03T12:35:34.603 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:34.598+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:34.599000+0000) 2021-08-03T12:35:35.152 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:35.148+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:35.149361+0000) 2021-08-03T12:35:35.223 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:35:35.217+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:35.218283+0000) 2021-08-03T12:35:35.435 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:35.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:35.432807+0000) 2021-08-03T12:35:35.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:35.529+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:35.530012+0000) 2021-08-03T12:35:35.603 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:35.599+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:35.599876+0000) 2021-08-03T12:35:36.154 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:36.149+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:36.150114+0000) 2021-08-03T12:35:36.435 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:36.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:36.432986+0000) 2021-08-03T12:35:36.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:36.529+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:36.530127+0000) 2021-08-03T12:35:36.604 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:36.599+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:36.600470+0000) 2021-08-03T12:35:37.154 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:37.150+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:37.151239+0000) 2021-08-03T12:35:37.282 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:37.278+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:37.279498+0000) 2021-08-03T12:35:37.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:37.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:37.433127+0000) 2021-08-03T12:35:37.533 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:37.529+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:37.530245+0000) 2021-08-03T12:35:37.605 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:37.600+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:37.601456+0000) 2021-08-03T12:35:38.155 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:38.151+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:38.152294+0000) 2021-08-03T12:35:38.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:38.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:38.433256+0000) 2021-08-03T12:35:38.533 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:38.529+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:38.530354+0000) 2021-08-03T12:35:38.605 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:38.601+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:38.602068+0000) 2021-08-03T12:35:38.698 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:38.628+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7518 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:39.156 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:39.152+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:39.152882+0000) 2021-08-03T12:35:39.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:39.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:39.433414+0000) 2021-08-03T12:35:39.533 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:39.529+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:39.530474+0000) 2021-08-03T12:35:39.571 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:39.407+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3143 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:39.606 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:39.601+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:39.602657+0000) 2021-08-03T12:35:39.979 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:39.975+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:39.976365+0000) 2021-08-03T12:35:40.156 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:40.151+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:40.153453+0000) 2021-08-03T12:35:40.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:40.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:40.433563+0000) 2021-08-03T12:35:41.157 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:41.152+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:41.154038+0000) 2021-08-03T12:35:41.283 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:41.279+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:41.280738+0000) 2021-08-03T12:35:41.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:41.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:41.433711+0000) 2021-08-03T12:35:42.158 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:42.153+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:42.155158+0000) 2021-08-03T12:35:42.283 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:42.280+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:42.280874+0000) 2021-08-03T12:35:42.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:42.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:42.433858+0000) 2021-08-03T12:35:42.799 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:35:42.793+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:42.794509+0000) 2021-08-03T12:35:42.811 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:35:42.807+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:42.807930+0000) 2021-08-03T12:35:43.160 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:43.154+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:43.156350+0000) 2021-08-03T12:35:43.283 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:43.280+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:43.281013+0000) 2021-08-03T12:35:43.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:43.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:43.434003+0000) 2021-08-03T12:35:43.871 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:43.825+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7488 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:44.161 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:44.155+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:44.157480+0000) 2021-08-03T12:35:44.283 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:44.280+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:44.281131+0000) 2021-08-03T12:35:44.437 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:44.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:44.434147+0000) 2021-08-03T12:35:45.162 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:45.156+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:45.158682+0000) 2021-08-03T12:35:45.284 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:45.280+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:45.281271+0000) 2021-08-03T12:35:45.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:45.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:45.434255+0000) 2021-08-03T12:35:46.163 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:46.158+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:46.159870+0000) 2021-08-03T12:35:46.380 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:46.376+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:46.377429+0000) 2021-08-03T12:35:46.623 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:46.618+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:46.620509+0000) 2021-08-03T12:35:47.168 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:47.160+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:47.161455+0000) 2021-08-03T12:35:47.382 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:47.378+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:47.379950+0000) 2021-08-03T12:35:47.997 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:47.923+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7526 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:48.385 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:48.380+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:48.382155+0000) 2021-08-03T12:35:48.996 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:35:48.990+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:48.992158+0000) 2021-08-03T12:35:49.385 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:49.380+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:49.382316+0000) 2021-08-03T12:35:49.467 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:49.463+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:49.465174+0000) 2021-08-03T12:35:50.003 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:35:49.999+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:49.999955+0000) 2021-08-03T12:35:50.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:50.037+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7488 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:50.075 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:35:50.070+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:50.070981+0000) 2021-08-03T12:35:50.385 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:50.380+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:50.382534+0000) 2021-08-03T12:35:50.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:50.713+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:50.715139+0000) 2021-08-03T12:35:51.127 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:50.851+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3146 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:51.385 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:51.380+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:51.382684+0000) 2021-08-03T12:35:51.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:51.723+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:51.725610+0000) 2021-08-03T12:35:51.932 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:51.928+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:51.928828+0000) 2021-08-03T12:35:52.029 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:52.023+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:52.024331+0000) 2021-08-03T12:35:52.163 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:52.157+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:52.159222+0000) 2021-08-03T12:35:52.385 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:52.381+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:52.382929+0000) 2021-08-03T12:35:52.749 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:35:52.742+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:52.744522+0000) 2021-08-03T12:35:53.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:53.862+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:53.864176+0000) 2021-08-03T12:35:53.919 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:53.914+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:53.915774+0000) 2021-08-03T12:35:54.534 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:54.530+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:54.531899+0000) 2021-08-03T12:35:54.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:54.862+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:54.864334+0000) 2021-08-03T12:35:54.919 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:54.915+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:54.916335+0000) 2021-08-03T12:35:55.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:55.863+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:55.864459+0000) 2021-08-03T12:35:55.920 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:55.916+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:55.917229+0000) 2021-08-03T12:35:56.421 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:56.416+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:56.417683+0000) 2021-08-03T12:35:56.606 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:35:56.596+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:56.597676+0000) 2021-08-03T12:35:56.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:56.863+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:56.864607+0000) 2021-08-03T12:35:56.921 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:35:56.917+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:56.917855+0000) 2021-08-03T12:35:57.014 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:35:56.905+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3148 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:35:57.235 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:35:57.230+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:57.231179+0000) 2021-08-03T12:35:57.422 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:35:57.418+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:57.418772+0000) 2021-08-03T12:35:57.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:35:57.863+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:57.864758+0000) 2021-08-03T12:35:58.446 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:35:58.146+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7526 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:35:59.202 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:35:58.438+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7488 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:35:59.550 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:35:59.546+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:35:59.547613+0000) 2021-08-03T12:36:00.613 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:36:00.608+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:00.609423+0000) 2021-08-03T12:36:03.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:03.137+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:03.137890+0000) 2021-08-03T12:36:03.446 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:03.441+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:03.442403+0000) 2021-08-03T12:36:04.383 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:04.379+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:04.380610+0000) 2021-08-03T12:36:04.385 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:04.382+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:04.383093+0000) 2021-08-03T12:36:04.557 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:04.553+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:04.553798+0000) 2021-08-03T12:36:05.008 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:04.415+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7488 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:05.227 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:05.222+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:05.222969+0000) 2021-08-03T12:36:05.558 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:05.553+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:05.554514+0000) 2021-08-03T12:36:05.832 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:05.613+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7526 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:05.835 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:36:05.829+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:05.830350+0000) 2021-08-03T12:36:06.227 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:06.223+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:06.223933+0000) 2021-08-03T12:36:06.437 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:06.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:06.434621+0000) 2021-08-03T12:36:06.559 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:06.554+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:06.555311+0000) 2021-08-03T12:36:06.609 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:36:05.948+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3149 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:36:06.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:06.715+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:06.716784+0000) 2021-08-03T12:36:07.221 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:07.216+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:07.216941+0000) 2021-08-03T12:36:07.228 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:07.223+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:07.224555+0000) 2021-08-03T12:36:07.437 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:07.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:07.434796+0000) 2021-08-03T12:36:07.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:07.718+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:07.719364+0000) 2021-08-03T12:36:08.050 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:08.045+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:08.046627+0000) 2021-08-03T12:36:08.229 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:08.224+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:08.225176+0000) 2021-08-03T12:36:08.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:08.722+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:08.723322+0000) 2021-08-03T12:36:08.744 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:36:08.740+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:08.740828+0000) 2021-08-03T12:36:09.050 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:09.046+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:09.047198+0000) 2021-08-03T12:36:09.229 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:09.225+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:09.225956+0000) 2021-08-03T12:36:09.447 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:09.442+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:09.442910+0000) 2021-08-03T12:36:09.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:09.722+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:09.723474+0000) 2021-08-03T12:36:10.051 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:10.046+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:10.047774+0000) 2021-08-03T12:36:10.229 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:10.225+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:10.226565+0000) 2021-08-03T12:36:10.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:10.722+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:10.723659+0000) 2021-08-03T12:36:11.051 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:11.047+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:11.048355+0000) 2021-08-03T12:36:11.230 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:11.226+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:11.227170+0000) 2021-08-03T12:36:11.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:11.722+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:11.723790+0000) 2021-08-03T12:36:11.921 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:11.916+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:11.916950+0000) 2021-08-03T12:36:12.052 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:12.048+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:12.048955+0000) 2021-08-03T12:36:12.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:12.197+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:12.198486+0000) 2021-08-03T12:36:12.231 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:12.227+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:12.227757+0000) 2021-08-03T12:36:12.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:12.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:12.724052+0000) 2021-08-03T12:36:12.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:12.875+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:12.876176+0000) 2021-08-03T12:36:12.965 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:12.630+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7488 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:13.052 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:13.048+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:13.049564+0000) 2021-08-03T12:36:13.157 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:36:13.153+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:13.154494+0000) 2021-08-03T12:36:13.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:13.197+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:13.198643+0000) 2021-08-03T12:36:13.232 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:13.228+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:13.229096+0000) 2021-08-03T12:36:13.359 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:13.058+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7526 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:13.727 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:13.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:13.724207+0000) 2021-08-03T12:36:14.054 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:36:14.049+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:14.050362+0000) 2021-08-03T12:36:14.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:14.197+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:14.198771+0000) 2021-08-03T12:36:14.234 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:14.229+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:14.230417+0000) 2021-08-03T12:36:14.727 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:14.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:14.724450+0000) 2021-08-03T12:36:14.945 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:36:14.893+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3164 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:36:15.235 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:15.230+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:15.231541+0000) 2021-08-03T12:36:15.727 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:15.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:15.724585+0000) 2021-08-03T12:36:16.236 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:16.231+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:16.232578+0000) 2021-08-03T12:36:16.727 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:16.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:16.724793+0000) 2021-08-03T12:36:17.237 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:17.232+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:17.233503+0000) 2021-08-03T12:36:17.647 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:36:17.640+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:17.641175+0000) 2021-08-03T12:36:17.727 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:17.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:17.724962+0000) 2021-08-03T12:36:18.237 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:18.233+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:18.234439+0000) 2021-08-03T12:36:18.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:18.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:18.725175+0000) 2021-08-03T12:36:19.239 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:19.234+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:19.235438+0000) 2021-08-03T12:36:19.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:19.614+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:19.615283+0000) 2021-08-03T12:36:19.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:19.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:19.725325+0000) 2021-08-03T12:36:19.827 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:19.823+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7527 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:20.080 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:20.071+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7488 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:20.240 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:20.235+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:20.236414+0000) 2021-08-03T12:36:20.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:20.614+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:20.615418+0000) 2021-08-03T12:36:20.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:20.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:20.725493+0000) 2021-08-03T12:36:21.242 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:21.237+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:21.237682+0000) 2021-08-03T12:36:21.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:21.614+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:21.615539+0000) 2021-08-03T12:36:21.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:21.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:21.725642+0000) 2021-08-03T12:36:22.196 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:36:21.843+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3164 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:36:22.242 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:22.238+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:22.239254+0000) 2021-08-03T12:36:22.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:22.614+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:22.615691+0000) 2021-08-03T12:36:22.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:22.725+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:22.725833+0000) 2021-08-03T12:36:23.244 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:23.239+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:23.240572+0000) 2021-08-03T12:36:23.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:23.615+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:23.615835+0000) 2021-08-03T12:36:23.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:23.725+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:23.725993+0000) 2021-08-03T12:36:24.245 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:24.241+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:24.241946+0000) 2021-08-03T12:36:24.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:24.615+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:24.615972+0000) 2021-08-03T12:36:24.729 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:24.725+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:24.726201+0000) 2021-08-03T12:36:25.251 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:25.242+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:25.243301+0000) 2021-08-03T12:36:25.496 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:25.475+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7490 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:25.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:25.615+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:25.616140+0000) 2021-08-03T12:36:25.729 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:25.725+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:25.726341+0000) 2021-08-03T12:36:26.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:26.615+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:26.616289+0000) 2021-08-03T12:36:26.729 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:26.725+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:26.726530+0000) 2021-08-03T12:36:27.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:27.615+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:27.616445+0000) 2021-08-03T12:36:27.623 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:27.447+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:28.425 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:28.421+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:28.422515+0000) 2021-08-03T12:36:28.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:28.615+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:28.616596+0000) 2021-08-03T12:36:29.427 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:29.422+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:29.423217+0000) 2021-08-03T12:36:29.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:29.615+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:29.616751+0000) 2021-08-03T12:36:30.427 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:30.423+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:30.423985+0000) 2021-08-03T12:36:30.875 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:36:30.871+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:30.872880+0000) 2021-08-03T12:36:31.428 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:31.423+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:31.424734+0000) 2021-08-03T12:36:31.639 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:36:31.634+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:31.635140+0000) 2021-08-03T12:36:32.117 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:36:32.099+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3169 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:36:32.429 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:32.424+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:32.425618+0000) 2021-08-03T12:36:32.712 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:32.575+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7490 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:32.782 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:32.776+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:32.777570+0000) 2021-08-03T12:36:33.429 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:33.425+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:33.426166+0000) 2021-08-03T12:36:34.147 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:34.140+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:34.142509+0000) 2021-08-03T12:36:34.430 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:34.425+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:34.426713+0000) 2021-08-03T12:36:35.430 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:35.426+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:35.427276+0000) 2021-08-03T12:36:35.588 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:36:35.582+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:35.584579+0000) 2021-08-03T12:36:35.875 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:35.728+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:36.431 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:36.427+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:36.427815+0000) 2021-08-03T12:36:37.431 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:37.427+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:37.428434+0000) 2021-08-03T12:36:37.562 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:37.556+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:37.558633+0000) 2021-08-03T12:36:38.436 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:38.428+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:38.429020+0000) 2021-08-03T12:36:38.563 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:38.557+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:38.559552+0000) 2021-08-03T12:36:38.584 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:36:38.579+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:38.581156+0000) 2021-08-03T12:36:38.822 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:36:38.816+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:38.818164+0000) 2021-08-03T12:36:39.151 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:39.128+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7490 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:40.274 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:40.269+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:40.271179+0000) 2021-08-03T12:36:41.001 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:36:40.646+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3180 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:36:41.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:36:41.540+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:41.541968+0000) 2021-08-03T12:36:42.522 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:42.410+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:48.351 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:47.984+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7490 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:50.524 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:50.153+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:51.338 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:36:51.129+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3189 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:36:51.625 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:36:51.616+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:51.617476+0000) 2021-08-03T12:36:55.254 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:36:54.972+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7490 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:36:57.775 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:57.769+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:57.770694+0000) 2021-08-03T12:36:58.437 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:58.432+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:58.433511+0000) 2021-08-03T12:36:58.826 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:36:58.739+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:36:59.380 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:36:59.374+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:59.375629+0000) 2021-08-03T12:36:59.437 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:36:59.433+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:59.434199+0000) 2021-08-03T12:36:59.828 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:36:59.824+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:36:59.825507+0000) 2021-08-03T12:37:00.438 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:00.434+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:00.434838+0000) 2021-08-03T12:37:00.450 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:37:00.445+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:00.446194+0000) 2021-08-03T12:37:00.494 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:00.490+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:00.491561+0000) 2021-08-03T12:37:01.019 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:00.501+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:01.439 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:01.434+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:01.435696+0000) 2021-08-03T12:37:02.164 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:37:02.159+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:02.160079+0000) 2021-08-03T12:37:02.439 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:02.435+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:02.436537+0000) 2021-08-03T12:37:02.532 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:02.138+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7491 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:02.634 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:02.630+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:02.631583+0000) 2021-08-03T12:37:02.905 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:02.901+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:02.902332+0000) 2021-08-03T12:37:02.953 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:02.949+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:02.950612+0000) 2021-08-03T12:37:03.263 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:03.258+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:03.259423+0000) 2021-08-03T12:37:03.440 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:03.436+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:03.437378+0000) 2021-08-03T12:37:03.953 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:03.949+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:03.950766+0000) 2021-08-03T12:37:04.003 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:03.999+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:04.000346+0000) 2021-08-03T12:37:04.281 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:04.277+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:04.277777+0000) 2021-08-03T12:37:04.441 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:04.437+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:04.437975+0000) 2021-08-03T12:37:04.770 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:04.766+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:04.767255+0000) 2021-08-03T12:37:04.953 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:04.950+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:04.950888+0000) 2021-08-03T12:37:05.039 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:05.023+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:05.182 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:05.179+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:05.180374+0000) 2021-08-03T12:37:05.232 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:37:05.226+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:05.227545+0000) 2021-08-03T12:37:05.753 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:05.748+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:05.748848+0000) 2021-08-03T12:37:05.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:05.770+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:05.771515+0000) 2021-08-03T12:37:06.481 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:06.475+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:06.476775+0000) 2021-08-03T12:37:06.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:06.773+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:06.773877+0000) 2021-08-03T12:37:06.869 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:06.866+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:06.866913+0000) 2021-08-03T12:37:07.442 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:37:07.437+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:07.438466+0000) 2021-08-03T12:37:07.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:07.773+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:07.774000+0000) 2021-08-03T12:37:08.751 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:08.688+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7508 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:09.444 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:09.439+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:09.439832+0000) 2021-08-03T12:37:10.135 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:09.789+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:10.270 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:37:10.264+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:10.265619+0000) 2021-08-03T12:37:10.669 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:10.665+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:10.666621+0000) 2021-08-03T12:37:10.797 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:10.793+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:10.793844+0000) 2021-08-03T12:37:10.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:10.957+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:10.958616+0000) 2021-08-03T12:37:11.301 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:37:11.296+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:11.297329+0000) 2021-08-03T12:37:11.894 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:11.888+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:12.014 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:12.009+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:12.009794+0000) 2021-08-03T12:37:12.014 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:12.010+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:12.011488+0000) 2021-08-03T12:37:12.018 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:12.014+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:12.015769+0000) 2021-08-03T12:37:12.449 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:37:12.443+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:12.444371+0000) 2021-08-03T12:37:12.465 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:12.462+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:12.462819+0000) 2021-08-03T12:37:12.929 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:37:12.924+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:12.925416+0000) 2021-08-03T12:37:13.771 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:13.766+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:13.767784+0000) 2021-08-03T12:37:13.931 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:37:13.926+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:13.927178+0000) 2021-08-03T12:37:13.932 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:37:13.926+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:13.927726+0000) 2021-08-03T12:37:14.570 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:14.565+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:14.566723+0000) 2021-08-03T12:37:14.599 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:14.577+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7510 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:14.939 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:14.933+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:14.934326+0000) 2021-08-03T12:37:15.565 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:15.561+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:15.562281+0000) 2021-08-03T12:37:15.846 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:37:15.841+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:15.842381+0000) 2021-08-03T12:37:15.847 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:15.843+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:15.844628+0000) 2021-08-03T12:37:16.031 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:16.025+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:16.026625+0000) 2021-08-03T12:37:16.461 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:16.457+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:16.458327+0000) 2021-08-03T12:37:16.820 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:37:16.814+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:16.815548+0000) 2021-08-03T12:37:16.981 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:16.857+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:16.983 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:16.979+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:16.980647+0000) 2021-08-03T12:37:17.650 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:17.646+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:17.646823+0000) 2021-08-03T12:37:18.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:18.412+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:18.413065+0000) 2021-08-03T12:37:18.535 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:18.532+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:18.532994+0000) 2021-08-03T12:37:18.651 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:18.646+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:18.647757+0000) 2021-08-03T12:37:19.536 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:19.532+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:19.533156+0000) 2021-08-03T12:37:19.651 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:19.647+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:19.648538+0000) 2021-08-03T12:37:19.877 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:19.648+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:20.652 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:20.648+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:20.649247+0000) 2021-08-03T12:37:20.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:20.652+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:20.653240+0000) 2021-08-03T12:37:21.077 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:21.073+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:21.074713+0000) 2021-08-03T12:37:21.460 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:37:21.453+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:21.455425+0000) 2021-08-03T12:37:21.510 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:21.505+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7510 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:21.653 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:21.649+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:21.650137+0000) 2021-08-03T12:37:21.663 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:21.658+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:21.659100+0000) 2021-08-03T12:37:22.110 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:22.106+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:22.107831+0000) 2021-08-03T12:37:22.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:22.154+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:22.156072+0000) 2021-08-03T12:37:22.918 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:22.912+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:22.913757+0000) 2021-08-03T12:37:23.454 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:37:23.447+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:23.449151+0000) 2021-08-03T12:37:23.672 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:23.666+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:23.667986+0000) 2021-08-03T12:37:24.026 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:23.669+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:24.192 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:24.188+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:24.189547+0000) 2021-08-03T12:37:25.449 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:25.445+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:25.446265+0000) 2021-08-03T12:37:25.954 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:25.949+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:25.951235+0000) 2021-08-03T12:37:26.450 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:26.446+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:26.446993+0000) 2021-08-03T12:37:26.611 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:26.606+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:26.608325+0000) 2021-08-03T12:37:26.954 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:26.949+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:26.951396+0000) 2021-08-03T12:37:27.451 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:27.447+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:27.447905+0000) 2021-08-03T12:37:27.613 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:27.608+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:27.610054+0000) 2021-08-03T12:37:27.954 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:27.949+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:27.951551+0000) 2021-08-03T12:37:28.438 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:28.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:28.435728+0000) 2021-08-03T12:37:28.452 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:28.447+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:28.448709+0000) 2021-08-03T12:37:28.614 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:28.608+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:28.610663+0000) 2021-08-03T12:37:29.046 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:28.958+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:29.438 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:29.434+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:29.435875+0000) 2021-08-03T12:37:29.615 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:29.609+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:29.611303+0000) 2021-08-03T12:37:29.824 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:29.801+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7514 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:31.226 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:30.996+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:33.166 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:33.161+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:33.162412+0000) 2021-08-03T12:37:34.166 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:34.162+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:34.163412+0000) 2021-08-03T12:37:35.167 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:35.163+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:35.163994+0000) 2021-08-03T12:37:36.168 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:36.163+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:36.164586+0000) 2021-08-03T12:37:37.168 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:37.164+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:37.165165+0000) 2021-08-03T12:37:37.437 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:37.233+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7542 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:38.168 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:38.164+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:38.165694+0000) 2021-08-03T12:37:38.353 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:38.095+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:38.468 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:38.463+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7551 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:39.170 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:39.165+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:39.166674+0000) 2021-08-03T12:37:40.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:40.026+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:40.027334+0000) 2021-08-03T12:37:40.170 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:40.166+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:40.167263+0000) 2021-08-03T12:37:41.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:41.026+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:41.027505+0000) 2021-08-03T12:37:41.171 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:41.167+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:41.167854+0000) 2021-08-03T12:37:42.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:42.026+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:42.027655+0000) 2021-08-03T12:37:42.171 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:42.167+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:42.168437+0000) 2021-08-03T12:37:43.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:43.026+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:43.027794+0000) 2021-08-03T12:37:43.172 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:43.168+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:43.169043+0000) 2021-08-03T12:37:43.565 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:43.530+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:44.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:44.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:44.027919+0000) 2021-08-03T12:37:44.087 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:44.083+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7546 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:44.173 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:44.168+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:44.169742+0000) 2021-08-03T12:37:45.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:45.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:45.028042+0000) 2021-08-03T12:37:45.173 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:45.169+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:45.170362+0000) 2021-08-03T12:37:45.418 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:45.414+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:45.415563+0000) 2021-08-03T12:37:46.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:46.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:46.028182+0000) 2021-08-03T12:37:46.175 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:46.170+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:46.171687+0000) 2021-08-03T12:37:46.830 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:46.826+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:46.827550+0000) 2021-08-03T12:37:47.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:47.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:47.028316+0000) 2021-08-03T12:37:47.176 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:47.171+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:47.172538+0000) 2021-08-03T12:37:47.299 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:47.139+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7581 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:48.025 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:48.020+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:48.021465+0000) 2021-08-03T12:37:48.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:48.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:48.028454+0000) 2021-08-03T12:37:48.177 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:48.172+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:48.173399+0000) 2021-08-03T12:37:48.698 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:48.693+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:48.694462+0000) 2021-08-03T12:37:48.954 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:48.951+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:48.951984+0000) 2021-08-03T12:37:49.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:49.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:49.028574+0000) 2021-08-03T12:37:49.177 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:49.173+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:49.174268+0000) 2021-08-03T12:37:49.322 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:49.318+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:49.319276+0000) 2021-08-03T12:37:49.456 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:49.452+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:49.453347+0000) 2021-08-03T12:37:49.638 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:49.632+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:49.633402+0000) 2021-08-03T12:37:49.694 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:37:49.689+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:49.690200+0000) 2021-08-03T12:37:49.955 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:49.951+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:49.952165+0000) 2021-08-03T12:37:50.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:50.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:50.028714+0000) 2021-08-03T12:37:50.178 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:50.174+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:50.175152+0000) 2021-08-03T12:37:50.457 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:50.453+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:50.453957+0000) 2021-08-03T12:37:50.536 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:50.532+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:50.533557+0000) 2021-08-03T12:37:50.787 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:37:50.781+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:50.782419+0000) 2021-08-03T12:37:50.955 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:50.951+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:50.952315+0000) 2021-08-03T12:37:50.978 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:37:50.973+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:50.974224+0000) 2021-08-03T12:37:50.980 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:50.774+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:51.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:51.027+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:51.028865+0000) 2021-08-03T12:37:51.154 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:51.082+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7552 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:51.179 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:51.174+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:51.175752+0000) 2021-08-03T12:37:51.458 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:51.453+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:51.454568+0000) 2021-08-03T12:37:51.628 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:37:51.623+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:51.624453+0000) 2021-08-03T12:37:51.955 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:51.951+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:51.952440+0000) 2021-08-03T12:37:52.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:52.028+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:52.028992+0000) 2021-08-03T12:37:52.179 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:52.175+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:52.176341+0000) 2021-08-03T12:37:52.458 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:37:52.454+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:52.455471+0000) 2021-08-03T12:37:52.529 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:37:52.524+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:52.524955+0000) 2021-08-03T12:37:52.662 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:37:52.654+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:52.655609+0000) 2021-08-03T12:37:52.955 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:52.951+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:52.952571+0000) 2021-08-03T12:37:53.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:53.028+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:53.029120+0000) 2021-08-03T12:37:53.184 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:53.176+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:53.176981+0000) 2021-08-03T12:37:53.934 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:37:53.928+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:53.929369+0000) 2021-08-03T12:37:53.936 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:53.932+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:53.933306+0000) 2021-08-03T12:37:53.955 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:37:53.951+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:53.952694+0000) 2021-08-03T12:37:54.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:54.028+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:54.029279+0000) 2021-08-03T12:37:55.031 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:55.028+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:55.029418+0000) 2021-08-03T12:37:55.101 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:37:54.866+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7603 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:37:55.328 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:37:55.323+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:55.324193+0000) 2021-08-03T12:37:56.032 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:56.028+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:56.029542+0000) 2021-08-03T12:37:56.806 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:37:56.801+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:56.802497+0000) 2021-08-03T12:37:57.032 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:57.028+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:57.029694+0000) 2021-08-03T12:37:57.418 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:37:57.412+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:57.413647+0000) 2021-08-03T12:37:58.032 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:58.028+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:58.029832+0000) 2021-08-03T12:37:58.178 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:37:58.152+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:37:58.437 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:37:58.431+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:58.432518+0000) 2021-08-03T12:37:58.813 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:37:58.743+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7556 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:37:59.032 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:37:59.029+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:37:59.029984+0000) 2021-08-03T12:38:00.032 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:00.029+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:00.030124+0000) 2021-08-03T12:38:00.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:00.180+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:00.181432+0000) 2021-08-03T12:38:00.622 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:00.617+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:00.618521+0000) 2021-08-03T12:38:01.136 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:01.106+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:01.623 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:01.618+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:01.619282+0000) 2021-08-03T12:38:01.765 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:01.759+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:01.760897+0000) 2021-08-03T12:38:02.623 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:02.619+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:02.619896+0000) 2021-08-03T12:38:03.434 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:03.427+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:03.429463+0000) 2021-08-03T12:38:03.624 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:03.619+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:03.620501+0000) 2021-08-03T12:38:04.275 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:04.272+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:04.273018+0000) 2021-08-03T12:38:04.624 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:04.620+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:04.621284+0000) 2021-08-03T12:38:05.392 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:05.388+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:05.389987+0000) 2021-08-03T12:38:05.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:05.393+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:05.394127+0000) 2021-08-03T12:38:05.625 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:05.621+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:05.621890+0000) 2021-08-03T12:38:05.711 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:05.455+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7556 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:06.518 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:06.513+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:06.514872+0000) 2021-08-03T12:38:06.625 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:06.621+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:06.622484+0000) 2021-08-03T12:38:07.010 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:07.005+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:07.006090+0000) 2021-08-03T12:38:07.130 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:07.085+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:07.627 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:07.622+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:07.623030+0000) 2021-08-03T12:38:08.011 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:07.912+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:08.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:08.705+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:08.707192+0000) 2021-08-03T12:38:12.002 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:11.998+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:11.999878+0000) 2021-08-03T12:38:13.209 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:38:13.203+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:13.205113+0000) 2021-08-03T12:38:13.366 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:13.362+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:13.363766+0000) 2021-08-03T12:38:13.462 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:13.458+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:13.459169+0000) 2021-08-03T12:38:13.608 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:13.601+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:13.603726+0000) 2021-08-03T12:38:14.071 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:13.909+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7556 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:14.366 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:14.363+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:14.363914+0000) 2021-08-03T12:38:14.463 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:14.459+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:14.459922+0000) 2021-08-03T12:38:14.504 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:14.499+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:14.500694+0000) 2021-08-03T12:38:14.521 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:38:14.515+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:14.517609+0000) 2021-08-03T12:38:14.612 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:14.510+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3190 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:14.895 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:14.783+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:15.463 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:15.459+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:15.460507+0000) 2021-08-03T12:38:16.116 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:16.111+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:16.112474+0000) 2021-08-03T12:38:16.464 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:16.460+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:16.461117+0000) 2021-08-03T12:38:17.141 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:17.136+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:17.138660+0000) 2021-08-03T12:38:17.465 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:17.461+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:17.461972+0000) 2021-08-03T12:38:17.678 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:17.674+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:17.675767+0000) 2021-08-03T12:38:17.863 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:17.858+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:17.859219+0000) 2021-08-03T12:38:18.466 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:18.461+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:18.462602+0000) 2021-08-03T12:38:18.684 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:18.679+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:18.679986+0000) 2021-08-03T12:38:18.881 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:18.878+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:18.879062+0000) 2021-08-03T12:38:19.446 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:19.442+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:19.443559+0000) 2021-08-03T12:38:19.466 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:19.462+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:19.463502+0000) 2021-08-03T12:38:20.467 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:20.463+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:20.464087+0000) 2021-08-03T12:38:20.536 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:20.532+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:20.533800+0000) 2021-08-03T12:38:20.707 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:20.658+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:20.857 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:20.852+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:20.853619+0000) 2021-08-03T12:38:21.204 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:21.199+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:21.200335+0000) 2021-08-03T12:38:21.468 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:21.463+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:21.464708+0000) 2021-08-03T12:38:21.536 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:21.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:21.533976+0000) 2021-08-03T12:38:21.633 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:21.628+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:21.629403+0000) 2021-08-03T12:38:21.858 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:21.853+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:21.854592+0000) 2021-08-03T12:38:22.036 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:21.923+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:22.421 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:22.417+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:22.418462+0000) 2021-08-03T12:38:22.468 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:22.464+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:22.465304+0000) 2021-08-03T12:38:22.532 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:22.527+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:22.528166+0000) 2021-08-03T12:38:22.536 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:22.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:22.534123+0000) 2021-08-03T12:38:22.633 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:22.629+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:22.630100+0000) 2021-08-03T12:38:22.664 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:22.659+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:22.660408+0000) 2021-08-03T12:38:22.858 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:22.854+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:22.855182+0000) 2021-08-03T12:38:23.011 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:22.954+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3194 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:23.469 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:23.465+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:23.465902+0000) 2021-08-03T12:38:23.532 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:23.528+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:23.529183+0000) 2021-08-03T12:38:23.537 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:23.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:23.534283+0000) 2021-08-03T12:38:23.634 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:23.629+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:23.630661+0000) 2021-08-03T12:38:23.664 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:23.660+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:23.661418+0000) 2021-08-03T12:38:23.859 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:23.854+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:23.855775+0000) 2021-08-03T12:38:24.469 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:24.465+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:24.466656+0000) 2021-08-03T12:38:24.533 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:24.529+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:24.529993+0000) 2021-08-03T12:38:24.537 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:24.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:24.534427+0000) 2021-08-03T12:38:24.634 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:24.630+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:24.631193+0000) 2021-08-03T12:38:24.665 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:24.661+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:24.662006+0000) 2021-08-03T12:38:24.807 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:24.804+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:24.804858+0000) 2021-08-03T12:38:25.216 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:25.211+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:25.212527+0000) 2021-08-03T12:38:25.470 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:25.466+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:25.467258+0000) 2021-08-03T12:38:25.534 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:25.529+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:25.530657+0000) 2021-08-03T12:38:26.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:26.444+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:26.445242+0000) 2021-08-03T12:38:26.471 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:26.467+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:26.467854+0000) 2021-08-03T12:38:26.534 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:26.530+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:26.531223+0000) 2021-08-03T12:38:27.106 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:38:27.101+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:27.102412+0000) 2021-08-03T12:38:27.450 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:27.447+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:27.447898+0000) 2021-08-03T12:38:27.472 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:27.467+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:27.468484+0000) 2021-08-03T12:38:27.535 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:27.531+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:27.531800+0000) 2021-08-03T12:38:27.863 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:27.797+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:28.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:28.449+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:28.450474+0000) 2021-08-03T12:38:28.472 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:28.468+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:28.469351+0000) 2021-08-03T12:38:28.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:28.796+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:28.797789+0000) 2021-08-03T12:38:29.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:29.360+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:29.361140+0000) 2021-08-03T12:38:29.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:29.449+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:29.450618+0000) 2021-08-03T12:38:29.473 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:29.469+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:29.469904+0000) 2021-08-03T12:38:29.947 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:29.784+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:30.005 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:29.800+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:30.227 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:30.222+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:30.223287+0000) 2021-08-03T12:38:30.339 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:30.334+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:30.334976+0000) 2021-08-03T12:38:30.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:30.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:30.436523+0000) 2021-08-03T12:38:30.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:30.450+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:30.450853+0000) 2021-08-03T12:38:30.473 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:30.469+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:30.470487+0000) 2021-08-03T12:38:31.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:31.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:31.436652+0000) 2021-08-03T12:38:31.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:31.450+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:31.450974+0000) 2021-08-03T12:38:31.474 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:31.470+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:31.471090+0000) 2021-08-03T12:38:31.659 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:31.654+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:31.655365+0000) 2021-08-03T12:38:32.475 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:32.471+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:32.471955+0000) 2021-08-03T12:38:32.969 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:38:32.963+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:32.964276+0000) 2021-08-03T12:38:33.252 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:33.227+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:33.292 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:33.287+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:33.288198+0000) 2021-08-03T12:38:33.476 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:33.471+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:33.472780+0000) 2021-08-03T12:38:33.724 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:33.721+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:33.721964+0000) 2021-08-03T12:38:34.477 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:34.473+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:34.473998+0000) 2021-08-03T12:38:35.477 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:35.473+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:35.474610+0000) 2021-08-03T12:38:35.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:35.857+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:35.858559+0000) 2021-08-03T12:38:36.478 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:36.474+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:36.475223+0000) 2021-08-03T12:38:37.479 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:37.475+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:37.475799+0000) 2021-08-03T12:38:37.583 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:37.577+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3229 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:37.589 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:37.583+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:37.584490+0000) 2021-08-03T12:38:38.198 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:38.194+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:38.195049+0000) 2021-08-03T12:38:38.479 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:38.475+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:38.476421+0000) 2021-08-03T12:38:38.535 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:38.515+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:39.198 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:39.194+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:39.195612+0000) 2021-08-03T12:38:39.480 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:39.476+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:39.476965+0000) 2021-08-03T12:38:39.578 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:38:39.574+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:39.574786+0000) 2021-08-03T12:38:40.099 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:39.979+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7560 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:40.199 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:40.195+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:40.196245+0000) 2021-08-03T12:38:40.481 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:40.476+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:40.477576+0000) 2021-08-03T12:38:40.574 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:40.568+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:40.568846+0000) 2021-08-03T12:38:40.579 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:38:40.574+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:40.575522+0000) 2021-08-03T12:38:40.983 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:40.977+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:40.978452+0000) 2021-08-03T12:38:41.200 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:41.196+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:41.197055+0000) 2021-08-03T12:38:41.481 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:41.477+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:41.478185+0000) 2021-08-03T12:38:42.162 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:42.159+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:42.159970+0000) 2021-08-03T12:38:42.205 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:42.197+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:42.197851+0000) 2021-08-03T12:38:42.482 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:42.478+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:42.478781+0000) 2021-08-03T12:38:43.201 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:43.197+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:43.198509+0000) 2021-08-03T12:38:43.483 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:43.478+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:43.479632+0000) 2021-08-03T12:38:43.777 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:38:43.772+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:43.773150+0000) 2021-08-03T12:38:44.100 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:43.983+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3242 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:44.202 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:44.198+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:44.199080+0000) 2021-08-03T12:38:44.484 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:44.479+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:44.480669+0000) 2021-08-03T12:38:45.203 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:45.199+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:45.200002+0000) 2021-08-03T12:38:45.484 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:45.480+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:45.481247+0000) 2021-08-03T12:38:45.487 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:45.391+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:45.923 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:45.920+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:45.921257+0000) 2021-08-03T12:38:45.969 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:45.964+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:45.965474+0000) 2021-08-03T12:38:46.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:46.245+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:46.246566+0000) 2021-08-03T12:38:46.485 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:46.481+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:46.481893+0000) 2021-08-03T12:38:46.537 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:46.533+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7560 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:47.423 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:47.420+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:47.420881+0000) 2021-08-03T12:38:47.485 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:47.481+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:47.482680+0000) 2021-08-03T12:38:47.948 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:47.943+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:47.943905+0000) 2021-08-03T12:38:48.486 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:48.482+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:48.483315+0000) 2021-08-03T12:38:48.644 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:48.640+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:48.641224+0000) 2021-08-03T12:38:48.701 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:48.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:48.697914+0000) 2021-08-03T12:38:48.701 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:48.697+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:48.698426+0000) 2021-08-03T12:38:49.487 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:49.483+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:49.483965+0000) 2021-08-03T12:38:49.499 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:38:49.494+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:49.494969+0000) 2021-08-03T12:38:49.700 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:49.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:49.698058+0000) 2021-08-03T12:38:50.488 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:50.484+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:50.484864+0000) 2021-08-03T12:38:50.700 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:50.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:50.698182+0000) 2021-08-03T12:38:50.758 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:50.754+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:50.754963+0000) 2021-08-03T12:38:51.406 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:38:51.400+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:51.401636+0000) 2021-08-03T12:38:51.413 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:51.409+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:51.410046+0000) 2021-08-03T12:38:51.488 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:51.484+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:51.485455+0000) 2021-08-03T12:38:51.700 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:51.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:51.698308+0000) 2021-08-03T12:38:51.723 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:38:51.718+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:51.719462+0000) 2021-08-03T12:38:52.158 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:52.150+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:52.151588+0000) 2021-08-03T12:38:52.192 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:52.172+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:38:52.489 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:52.485+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:52.486047+0000) 2021-08-03T12:38:52.701 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:52.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:52.698465+0000) 2021-08-03T12:38:52.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:52.733+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:52.734102+0000) 2021-08-03T12:38:52.763 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:52.724+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3256 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:53.490 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:53.485+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:53.486645+0000) 2021-08-03T12:38:54.256 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:38:54.236+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:38:54.288 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:54.284+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:54.285613+0000) 2021-08-03T12:38:54.517 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:38:54.513+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:54.514770+0000) 2021-08-03T12:38:55.282 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:55.276+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:55.277725+0000) 2021-08-03T12:38:55.537 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:55.534+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:55.534837+0000) 2021-08-03T12:38:55.642 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:55.638+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:55.638803+0000) 2021-08-03T12:38:55.671 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:55.666+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:55.667630+0000) 2021-08-03T12:38:55.907 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:55.901+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:55.902304+0000) 2021-08-03T12:38:55.913 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:55.909+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:55.910507+0000) 2021-08-03T12:38:56.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:56.413+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:56.414288+0000) 2021-08-03T12:38:56.537 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:56.534+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:56.534957+0000) 2021-08-03T12:38:56.643 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:56.638+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:56.639598+0000) 2021-08-03T12:38:56.671 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:56.667+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:56.668344+0000) 2021-08-03T12:38:56.700 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:38:56.695+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:56.696643+0000) 2021-08-03T12:38:57.538 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:57.534+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:57.535117+0000) 2021-08-03T12:38:57.643 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:57.639+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:57.640223+0000) 2021-08-03T12:38:57.672 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:57.668+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:57.668926+0000) 2021-08-03T12:38:58.538 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:58.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:58.535268+0000) 2021-08-03T12:38:58.540 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:58.536+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:58.537356+0000) 2021-08-03T12:38:58.644 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:58.639+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:58.640839+0000) 2021-08-03T12:38:58.673 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:58.669+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:58.669829+0000) 2021-08-03T12:38:58.929 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:38:58.724+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3274 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:38:59.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:59.254+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:59.256491+0000) 2021-08-03T12:38:59.538 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:38:59.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:59.535416+0000) 2021-08-03T12:38:59.540 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:38:59.536+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:59.537065+0000) 2021-08-03T12:38:59.541 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:38:59.537+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:59.538048+0000) 2021-08-03T12:38:59.644 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:38:59.639+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:59.641475+0000) 2021-08-03T12:38:59.673 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:38:59.669+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:38:59.670437+0000) 2021-08-03T12:38:59.998 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:38:59.977+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:00.311 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:00.307+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:00.308992+0000) 2021-08-03T12:39:00.538 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:00.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:00.535532+0000) 2021-08-03T12:39:00.541 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:00.537+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:00.537818+0000) 2021-08-03T12:39:00.541 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:00.537+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:00.538620+0000) 2021-08-03T12:39:00.646 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:00.640+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:00.642117+0000) 2021-08-03T12:39:00.674 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:00.670+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:00.671033+0000) 2021-08-03T12:39:01.244 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:01.240+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:01.241280+0000) 2021-08-03T12:39:01.326 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:01.321+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:01.322484+0000) 2021-08-03T12:39:01.538 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:01.533+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:01.535652+0000) 2021-08-03T12:39:01.541 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:01.537+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:01.538705+0000) 2021-08-03T12:39:01.543 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:01.538+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:01.539586+0000) 2021-08-03T12:39:01.646 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:01.641+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:01.642910+0000) 2021-08-03T12:39:01.674 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:01.670+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:01.671604+0000) 2021-08-03T12:39:01.895 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:01.888+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7571 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:02.245 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:02.241+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:02.241884+0000) 2021-08-03T12:39:02.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:02.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:02.437095+0000) 2021-08-03T12:39:02.454 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:02.449+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:02.451496+0000) 2021-08-03T12:39:02.542 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:02.538+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:02.539139+0000) 2021-08-03T12:39:02.647 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:02.641+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:02.643508+0000) 2021-08-03T12:39:02.675 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:02.671+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:02.672171+0000) 2021-08-03T12:39:03.245 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:03.241+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:03.242487+0000) 2021-08-03T12:39:03.322 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:03.317+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:03.319417+0000) 2021-08-03T12:39:03.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:03.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:03.437209+0000) 2021-08-03T12:39:03.543 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:03.539+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:03.540001+0000) 2021-08-03T12:39:03.647 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:03.642+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:03.644093+0000) 2021-08-03T12:39:03.676 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:03.672+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:03.672813+0000) 2021-08-03T12:39:04.247 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:04.242+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:04.243559+0000) 2021-08-03T12:39:04.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:04.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:04.437315+0000) 2021-08-03T12:39:04.544 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:04.540+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:04.541055+0000) 2021-08-03T12:39:04.648 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:04.642+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:04.644676+0000) 2021-08-03T12:39:04.677 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:04.673+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:04.673849+0000) 2021-08-03T12:39:04.951 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:04.946+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:04.947792+0000) 2021-08-03T12:39:05.248 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:05.243+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:05.244643+0000) 2021-08-03T12:39:05.367 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:05.362+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:05.364207+0000) 2021-08-03T12:39:05.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:05.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:05.437479+0000) 2021-08-03T12:39:05.545 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:05.541+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:05.541805+0000) 2021-08-03T12:39:05.649 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:05.643+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:05.645283+0000) 2021-08-03T12:39:05.677 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:05.673+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:05.674523+0000) 2021-08-03T12:39:05.927 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:39:05.920+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3279 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:39:05.952 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:05.946+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:05.948526+0000) 2021-08-03T12:39:06.249 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:06.245+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:06.245841+0000) 2021-08-03T12:39:06.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:06.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:06.437628+0000) 2021-08-03T12:39:06.584 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:06.532+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:06.649 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:06.644+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:06.646024+0000) 2021-08-03T12:39:06.679 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:06.675+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:06.675999+0000) 2021-08-03T12:39:06.929 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:06.925+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:06.926880+0000) 2021-08-03T12:39:06.953 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:06.947+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:06.949139+0000) 2021-08-03T12:39:07.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:07.153+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:07.154140+0000) 2021-08-03T12:39:07.250 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:07.246+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:07.247023+0000) 2021-08-03T12:39:07.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:07.435+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:07.437764+0000) 2021-08-03T12:39:07.649 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:07.644+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:07.646585+0000) 2021-08-03T12:39:07.679 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:07.675+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:07.676575+0000) 2021-08-03T12:39:07.953 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:07.949+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:07.949892+0000) 2021-08-03T12:39:08.106 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:08.101+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:08.102254+0000) 2021-08-03T12:39:08.252 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:08.247+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:08.248303+0000) 2021-08-03T12:39:08.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:08.437+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:08.437869+0000) 2021-08-03T12:39:08.633 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:08.628+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:08.629212+0000) 2021-08-03T12:39:08.650 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:08.646+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:08.647544+0000) 2021-08-03T12:39:08.680 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:08.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:08.677138+0000) 2021-08-03T12:39:08.953 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:08.949+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:08.950438+0000) 2021-08-03T12:39:09.252 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:09.248+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:09.249591+0000) 2021-08-03T12:39:09.441 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:09.437+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:09.437965+0000) 2021-08-03T12:39:09.633 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:09.629+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:09.630112+0000) 2021-08-03T12:39:09.651 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:09.647+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:09.648155+0000) 2021-08-03T12:39:09.681 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:09.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:09.677788+0000) 2021-08-03T12:39:09.955 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:09.950+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:09.951234+0000) 2021-08-03T12:39:10.441 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:10.437+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:10.438087+0000) 2021-08-03T12:39:10.634 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:10.630+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:10.630719+0000) 2021-08-03T12:39:10.681 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:10.677+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:10.678388+0000) 2021-08-03T12:39:10.955 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:10.951+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:10.951798+0000) 2021-08-03T12:39:11.441 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:11.437+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:11.438239+0000) 2021-08-03T12:39:11.529 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:39:11.524+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3283 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:39:11.583 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:39:11.579+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:11.580522+0000) 2021-08-03T12:39:11.634 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:11.630+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:11.631316+0000) 2021-08-03T12:39:11.682 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:11.678+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:11.678989+0000) 2021-08-03T12:39:11.956 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:11.951+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:11.952395+0000) 2021-08-03T12:39:12.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:12.358+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:12.359663+0000) 2021-08-03T12:39:12.475 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:12.455+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7584 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:12.635 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:12.631+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:12.631924+0000) 2021-08-03T12:39:12.683 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:12.678+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:12.679630+0000) 2021-08-03T12:39:12.956 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:12.952+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:12.952961+0000) 2021-08-03T12:39:13.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:13.469+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:13.470583+0000) 2021-08-03T12:39:13.636 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:13.631+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:13.632516+0000) 2021-08-03T12:39:13.683 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:13.679+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:13.680238+0000) 2021-08-03T12:39:13.957 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:13.952+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:13.953505+0000) 2021-08-03T12:39:14.637 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:14.632+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:14.633104+0000) 2021-08-03T12:39:14.684 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:14.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:14.680854+0000) 2021-08-03T12:39:14.956 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:14.952+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:14.953704+0000) 2021-08-03T12:39:14.958 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:14.953+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:14.954078+0000) 2021-08-03T12:39:15.148 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:14.559+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:15.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:15.220+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:15.221683+0000) 2021-08-03T12:39:15.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:15.220+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:15.221781+0000) 2021-08-03T12:39:15.637 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:15.633+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:15.633873+0000) 2021-08-03T12:39:15.684 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:15.679+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:15.681444+0000) 2021-08-03T12:39:15.956 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:15.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:15.953835+0000) 2021-08-03T12:39:15.958 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:15.954+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:15.955075+0000) 2021-08-03T12:39:16.108 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:16.102+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:16.103528+0000) 2021-08-03T12:39:16.638 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:16.633+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:16.634409+0000) 2021-08-03T12:39:16.685 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:16.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:16.682156+0000) 2021-08-03T12:39:16.956 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:16.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:16.953994+0000) 2021-08-03T12:39:16.959 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:16.955+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:16.955753+0000) 2021-08-03T12:39:17.639 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:17.635+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:17.636261+0000) 2021-08-03T12:39:17.686 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:17.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:17.682739+0000) 2021-08-03T12:39:17.747 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:17.743+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:17.745223+0000) 2021-08-03T12:39:17.957 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:17.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:17.954115+0000) 2021-08-03T12:39:17.959 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:17.955+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:17.956499+0000) 2021-08-03T12:39:18.640 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:18.636+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:18.637029+0000) 2021-08-03T12:39:18.687 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:18.681+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:18.683573+0000) 2021-08-03T12:39:18.957 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:18.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:18.954299+0000) 2021-08-03T12:39:18.961 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:18.957+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:18.957701+0000) 2021-08-03T12:39:19.641 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:19.636+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:19.637679+0000) 2021-08-03T12:39:19.687 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:19.682+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:19.684210+0000) 2021-08-03T12:39:19.957 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:19.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:19.954450+0000) 2021-08-03T12:39:19.961 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:19.957+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:19.958430+0000) 2021-08-03T12:39:20.023 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:39:20.018+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:20.019559+0000) 2021-08-03T12:39:20.641 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:20.637+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:20.638213+0000) 2021-08-03T12:39:20.688 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:20.683+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:20.685012+0000) 2021-08-03T12:39:20.957 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:20.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:20.954577+0000) 2021-08-03T12:39:20.962 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:20.958+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:20.959022+0000) 2021-08-03T12:39:21.642 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:21.638+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:21.638796+0000) 2021-08-03T12:39:21.957 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:21.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:21.954721+0000) 2021-08-03T12:39:21.963 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:21.959+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:21.959853+0000) 2021-08-03T12:39:22.069 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:21.879+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7602 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:22.205 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:22.200+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7604 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:22.222 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:22.216+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:22.218433+0000) 2021-08-03T12:39:22.643 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:22.638+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:22.639392+0000) 2021-08-03T12:39:22.957 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:22.954+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:22.954881+0000) 2021-08-03T12:39:22.963 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:22.959+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:22.960485+0000) 2021-08-03T12:39:23.204 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:39:22.963+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3297 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:39:23.206 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:23.200+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:23.202114+0000) 2021-08-03T12:39:23.643 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:23.639+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:23.639958+0000) 2021-08-03T12:39:23.965 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:23.960+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:23.961323+0000) 2021-08-03T12:39:24.168 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:24.163+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:24.164067+0000) 2021-08-03T12:39:24.644 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:24.640+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:24.640753+0000) 2021-08-03T12:39:24.967 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:24.961+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:24.961922+0000) 2021-08-03T12:39:25.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:25.196+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:25.197392+0000) 2021-08-03T12:39:25.281 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:25.276+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:25.277500+0000) 2021-08-03T12:39:25.645 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:25.641+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:25.641950+0000) 2021-08-03T12:39:26.132 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:26.128+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:26.129839+0000) 2021-08-03T12:39:26.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:26.631+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:26.632082+0000) 2021-08-03T12:39:26.646 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:26.641+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:26.642547+0000) 2021-08-03T12:39:27.135 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:27.131+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:27.132488+0000) 2021-08-03T12:39:27.646 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:27.642+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:27.643177+0000) 2021-08-03T12:39:28.137 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:28.133+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:28.133982+0000) 2021-08-03T12:39:28.649 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:28.643+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:28.643745+0000) 2021-08-03T12:39:28.987 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:28.983+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:28.984490+0000) 2021-08-03T12:39:29.137 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:29.133+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:29.134556+0000) 2021-08-03T12:39:29.776 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:29.770+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:29.771068+0000) 2021-08-03T12:39:30.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:30.022+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:30.023788+0000) 2021-08-03T12:39:30.138 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:30.134+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:30.135139+0000) 2021-08-03T12:39:30.164 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:30.098+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7609 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:30.344 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:30.201+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:30.407 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:30.402+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:30.403273+0000) 2021-08-03T12:39:30.655 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:30.650+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:30.651642+0000) 2021-08-03T12:39:31.139 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:31.135+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:31.135950+0000) 2021-08-03T12:39:31.262 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:39:31.216+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3298 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:39:31.492 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:39:31.487+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:31.488411+0000) 2021-08-03T12:39:31.655 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:31.651+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:31.652209+0000) 2021-08-03T12:39:32.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:32.535+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:32.536014+0000) 2021-08-03T12:39:32.549 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:32.543+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:32.544349+0000) 2021-08-03T12:39:32.572 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:32.567+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:32.568218+0000) 2021-08-03T12:39:32.656 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:32.652+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:32.652809+0000) 2021-08-03T12:39:32.845 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:32.840+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:32.841068+0000) 2021-08-03T12:39:33.457 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:33.453+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:33.454285+0000) 2021-08-03T12:39:33.538 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:33.535+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:33.536166+0000) 2021-08-03T12:39:33.656 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:33.652+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:33.653403+0000) 2021-08-03T12:39:34.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:34.455+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:34.456798+0000) 2021-08-03T12:39:34.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:34.473+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:34.474086+0000) 2021-08-03T12:39:34.657 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:34.653+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:34.654027+0000) 2021-08-03T12:39:35.025 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:35.021+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:35.022197+0000) 2021-08-03T12:39:35.463 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:35.460+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:35.460942+0000) 2021-08-03T12:39:35.658 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:35.653+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:35.654675+0000) 2021-08-03T12:39:36.026 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:36.022+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:36.022961+0000) 2021-08-03T12:39:36.217 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:36.212+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:36.213658+0000) 2021-08-03T12:39:36.464 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:36.460+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:36.461215+0000) 2021-08-03T12:39:36.659 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:36.654+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:36.655287+0000) 2021-08-03T12:39:36.946 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:36.774+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:37.027 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:37.023+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:37.024195+0000) 2021-08-03T12:39:37.137 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:37.131+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:37.132758+0000) 2021-08-03T12:39:37.216 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:37.211+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:37.212083+0000) 2021-08-03T12:39:37.311 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:37.307+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:37.308741+0000) 2021-08-03T12:39:37.464 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:37.460+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:37.461358+0000) 2021-08-03T12:39:37.498 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:37.494+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:37.495156+0000) 2021-08-03T12:39:37.659 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:37.655+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:37.655890+0000) 2021-08-03T12:39:38.032 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:38.024+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:38.024805+0000) 2021-08-03T12:39:38.198 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:39:38.022+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3301 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:39:38.464 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:38.460+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:38.461571+0000) 2021-08-03T12:39:39.029 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:39.025+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:39.025855+0000) 2021-08-03T12:39:39.084 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:39.079+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:39.889 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:39.884+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:39.885680+0000) 2021-08-03T12:39:40.030 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:40.025+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:40.026699+0000) 2021-08-03T12:39:40.891 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:40.886+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:40.887584+0000) 2021-08-03T12:39:41.030 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:41.026+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:41.027516+0000) 2021-08-03T12:39:41.891 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:41.887+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:41.888389+0000) 2021-08-03T12:39:42.031 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:42.027+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:42.028332+0000) 2021-08-03T12:39:42.270 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:42.265+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:42.266079+0000) 2021-08-03T12:39:42.892 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:42.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:42.888970+0000) 2021-08-03T12:39:43.032 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:43.028+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:43.028980+0000) 2021-08-03T12:39:43.271 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:43.266+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:43.267069+0000) 2021-08-03T12:39:43.464 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:43.459+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:43.460443+0000) 2021-08-03T12:39:43.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:43.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:43.699517+0000) 2021-08-03T12:39:43.893 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:43.888+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:43.889776+0000) 2021-08-03T12:39:44.033 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:44.029+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:44.029964+0000) 2021-08-03T12:39:44.147 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:44.138+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:44.271 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:44.267+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:44.267898+0000) 2021-08-03T12:39:44.311 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:44.306+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:44.306775+0000) 2021-08-03T12:39:44.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:44.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:44.699691+0000) 2021-08-03T12:39:44.894 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:44.889+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:44.890676+0000) 2021-08-03T12:39:45.025 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:45.022+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:45.022955+0000) 2021-08-03T12:39:45.033 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:45.029+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:45.030568+0000) 2021-08-03T12:39:45.272 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:45.267+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:45.268464+0000) 2021-08-03T12:39:45.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:45.683+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:45.684783+0000) 2021-08-03T12:39:45.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:45.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:45.699838+0000) 2021-08-03T12:39:45.735 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:39:45.730+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:45.731434+0000) 2021-08-03T12:39:45.848 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:39:45.759+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3323 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:39:45.894 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:45.890+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:45.891318+0000) 2021-08-03T12:39:45.946 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:45.845+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:46.034 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:46.030+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:46.031491+0000) 2021-08-03T12:39:46.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:46.125+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:46.126453+0000) 2021-08-03T12:39:46.272 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:46.268+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:46.269639+0000) 2021-08-03T12:39:46.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:46.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:46.699979+0000) 2021-08-03T12:39:46.895 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:46.891+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:46.892134+0000) 2021-08-03T12:39:47.018 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:47.012+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:47.013382+0000) 2021-08-03T12:39:47.035 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:47.031+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:47.032049+0000) 2021-08-03T12:39:47.273 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:47.269+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:47.270187+0000) 2021-08-03T12:39:47.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:47.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:47.700121+0000) 2021-08-03T12:39:47.896 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:47.891+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:47.892679+0000) 2021-08-03T12:39:48.035 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:48.031+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:48.032649+0000) 2021-08-03T12:39:48.274 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:48.269+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:48.270748+0000) 2021-08-03T12:39:48.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:48.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:48.700247+0000) 2021-08-03T12:39:48.897 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:48.892+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:48.893485+0000) 2021-08-03T12:39:49.508 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:49.503+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:49.504804+0000) 2021-08-03T12:39:49.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:49.736+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:49.737861+0000) 2021-08-03T12:39:50.376 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:50.371+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:50.372339+0000) 2021-08-03T12:39:50.554 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:39:50.550+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:50.551539+0000) 2021-08-03T12:39:50.555 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:50.550+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:50.551012+0000) 2021-08-03T12:39:50.905 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:50.793+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7613 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:51.468 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:51.207+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:51.474 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:51.470+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:51.471114+0000) 2021-08-03T12:39:51.749 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:39:51.744+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:51.744814+0000) 2021-08-03T12:39:52.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:52.263+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:52.265032+0000) 2021-08-03T12:39:53.681 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:39:53.636+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3325 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:39:53.958 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:53.953+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:53.955264+0000) 2021-08-03T12:39:54.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:54.484+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:54.485867+0000) 2021-08-03T12:39:55.175 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:39:55.169+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:55.170754+0000) 2021-08-03T12:39:55.931 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:39:55.925+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:55.927376+0000) 2021-08-03T12:39:56.226 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:39:56.220+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:56.222023+0000) 2021-08-03T12:39:56.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:39:56.784+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:56.785819+0000) 2021-08-03T12:39:57.078 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:39:56.824+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7615 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:39:58.305 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:58.300+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:58.301184+0000) 2021-08-03T12:39:58.409 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:39:58.404+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:58.405404+0000) 2021-08-03T12:39:58.520 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:39:58.423+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:39:58.621 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:39:58.615+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:58.616758+0000) 2021-08-03T12:39:59.208 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:39:59.203+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:59.203916+0000) 2021-08-03T12:39:59.282 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:39:59.277+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:59.278305+0000) 2021-08-03T12:39:59.306 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:39:59.301+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:39:59.302150+0000) 2021-08-03T12:40:00.306 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:00.302+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:00.302921+0000) 2021-08-03T12:40:00.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:00.451+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:00.452616+0000) 2021-08-03T12:40:01.218 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:40:01.211+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:01.212725+0000) 2021-08-03T12:40:01.221 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:01.217+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:01.217867+0000) 2021-08-03T12:40:01.307 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:01.302+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:01.303487+0000) 2021-08-03T12:40:01.347 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:00.921+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3332 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:01.988 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:01.983+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:01.984405+0000) 2021-08-03T12:40:02.307 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:02.303+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:02.304109+0000) 2021-08-03T12:40:02.552 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:02.548+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:02.548970+0000) 2021-08-03T12:40:02.988 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:02.984+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:02.985164+0000) 2021-08-03T12:40:03.308 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:03.303+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:03.304707+0000) 2021-08-03T12:40:03.553 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:03.548+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:03.549689+0000) 2021-08-03T12:40:03.989 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:03.985+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:03.985741+0000) 2021-08-03T12:40:04.309 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:04.304+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:04.305317+0000) 2021-08-03T12:40:04.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:04.535+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:04.536558+0000) 2021-08-03T12:40:04.553 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:04.549+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:04.550275+0000) 2021-08-03T12:40:04.831 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:04.751+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7615 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:04.990 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:04.986+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:04.986747+0000) 2021-08-03T12:40:05.309 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:05.305+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:05.305904+0000) 2021-08-03T12:40:05.464 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:05.460+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:05.461350+0000) 2021-08-03T12:40:05.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:05.535+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:05.536722+0000) 2021-08-03T12:40:05.991 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:05.986+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:05.987357+0000) 2021-08-03T12:40:06.310 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:06.306+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:06.306740+0000) 2021-08-03T12:40:06.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:06.536+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:06.536843+0000) 2021-08-03T12:40:06.991 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:06.987+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:06.987922+0000) 2021-08-03T12:40:07.253 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:07.234+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:07.310 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:07.306+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:07.307348+0000) 2021-08-03T12:40:07.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:07.341+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:07.342798+0000) 2021-08-03T12:40:07.368 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:07.362+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:07.363643+0000) 2021-08-03T12:40:07.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:07.536+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:07.537008+0000) 2021-08-03T12:40:08.312 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:08.307+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:08.307928+0000) 2021-08-03T12:40:09.464 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:09.461+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:09.461983+0000) 2021-08-03T12:40:09.563 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:09.558+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:09.558925+0000) 2021-08-03T12:40:09.590 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:09.551+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3365 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:09.871 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:40:09.865+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:09.866427+0000) 2021-08-03T12:40:11.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:11.262+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:11.263461+0000) 2021-08-03T12:40:11.591 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:11.587+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:11.587805+0000) 2021-08-03T12:40:11.990 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:11.986+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7615 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:12.267 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:12.263+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:12.264121+0000) 2021-08-03T12:40:12.592 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:12.588+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:12.588841+0000) 2021-08-03T12:40:12.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:12.701+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:12.702607+0000) 2021-08-03T12:40:13.593 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:13.588+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:13.589721+0000) 2021-08-03T12:40:13.959 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:13.954+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:13.954867+0000) 2021-08-03T12:40:14.594 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:14.589+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:14.590685+0000) 2021-08-03T12:40:14.595 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:14.590+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:14.591641+0000) 2021-08-03T12:40:15.041 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:15.038+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:15.038843+0000) 2021-08-03T12:40:15.540 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:40:15.534+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:15.535689+0000) 2021-08-03T12:40:15.595 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:15.591+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:15.592329+0000) 2021-08-03T12:40:15.596 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:15.591+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:15.591872+0000) 2021-08-03T12:40:16.081 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:15.687+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:16.596 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:16.592+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:16.592916+0000) 2021-08-03T12:40:16.597 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:16.592+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:16.592867+0000) 2021-08-03T12:40:17.597 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:17.592+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:17.593556+0000) 2021-08-03T12:40:17.598 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:17.593+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:17.594350+0000) 2021-08-03T12:40:18.598 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:18.593+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:18.594532+0000) 2021-08-03T12:40:18.599 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:18.594+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:18.595444+0000) 2021-08-03T12:40:18.853 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:18.680+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3404 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:19.156 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:18.903+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7615 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:19.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:19.269+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:19.270089+0000) 2021-08-03T12:40:19.598 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:19.594+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:19.595123+0000) 2021-08-03T12:40:19.599 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:19.595+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:19.596411+0000) 2021-08-03T12:40:19.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:40:19.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:19.700652+0000) 2021-08-03T12:40:20.599 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:20.594+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:20.595708+0000) 2021-08-03T12:40:20.600 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:20.596+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:20.597409+0000) 2021-08-03T12:40:20.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:20.856+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:20.857271+0000) 2021-08-03T12:40:20.973 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:20.948+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7631 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:21.290 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:21.285+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:21.285891+0000) 2021-08-03T12:40:21.600 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:21.595+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:21.596493+0000) 2021-08-03T12:40:21.602 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:21.597+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:21.598422+0000) 2021-08-03T12:40:22.077 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:22.071+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:22.071932+0000) 2021-08-03T12:40:22.600 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:22.596+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:22.597002+0000) 2021-08-03T12:40:22.603 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:22.599+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:22.599735+0000) 2021-08-03T12:40:23.134 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:40:23.128+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:23.129631+0000) 2021-08-03T12:40:23.602 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:23.596+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:23.597581+0000) 2021-08-03T12:40:23.604 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:23.599+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:23.600683+0000) 2021-08-03T12:40:23.920 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:23.915+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:23.916275+0000) 2021-08-03T12:40:24.602 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:24.598+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:24.599112+0000) 2021-08-03T12:40:24.605 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:24.600+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:24.601662+0000) 2021-08-03T12:40:24.958 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:24.954+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:24.955685+0000) 2021-08-03T12:40:25.606 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:25.600+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:25.601195+0000) 2021-08-03T12:40:25.610 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:25.606+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:25.606268+0000) 2021-08-03T12:40:25.958 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:25.955+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:25.955839+0000) 2021-08-03T12:40:26.605 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:26.600+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:26.601706+0000) 2021-08-03T12:40:26.606 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:26.602+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:26.602809+0000) 2021-08-03T12:40:26.611 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:26.607+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:26.608219+0000) 2021-08-03T12:40:26.807 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:40:26.804+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:26.805250+0000) 2021-08-03T12:40:26.958 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:26.955+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:26.955983+0000) 2021-08-03T12:40:27.111 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:26.974+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3411 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:27.146 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:27.141+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:27.142157+0000) 2021-08-03T12:40:27.183 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:27.089+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7626 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:27.605 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:27.600+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:27.602498+0000) 2021-08-03T12:40:27.606 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:27.601+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:27.603620+0000) 2021-08-03T12:40:27.612 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:27.608+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:27.609219+0000) 2021-08-03T12:40:27.743 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:40:27.736+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:27.738117+0000) 2021-08-03T12:40:27.958 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:27.955+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:27.956131+0000) 2021-08-03T12:40:27.997 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:27.992+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:27.993078+0000) 2021-08-03T12:40:28.309 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:28.305+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:28.306500+0000) 2021-08-03T12:40:28.606 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:28.601+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:28.603276+0000) 2021-08-03T12:40:28.607 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:28.602+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:28.604698+0000) 2021-08-03T12:40:28.613 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:28.609+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:28.610147+0000) 2021-08-03T12:40:28.625 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:28.492+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7640 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:28.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:28.955+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:28.956283+0000) 2021-08-03T12:40:29.607 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:29.602+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:29.603844+0000) 2021-08-03T12:40:29.615 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:29.610+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:29.611169+0000) 2021-08-03T12:40:29.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:29.955+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:29.956404+0000) 2021-08-03T12:40:30.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:30.358+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:30.359423+0000) 2021-08-03T12:40:30.607 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:30.602+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:30.604406+0000) 2021-08-03T12:40:30.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:30.955+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:30.956555+0000) 2021-08-03T12:40:30.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:30.959+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:30.960363+0000) 2021-08-03T12:40:31.404 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:31.398+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:31.400438+0000) 2021-08-03T12:40:31.518 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:31.512+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:31.514515+0000) 2021-08-03T12:40:31.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:31.955+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:31.956714+0000) 2021-08-03T12:40:32.244 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:32.238+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:32.239076+0000) 2021-08-03T12:40:32.342 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:40:32.337+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:32.338491+0000) 2021-08-03T12:40:32.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:32.695+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:32.696210+0000) 2021-08-03T12:40:32.955 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:32.951+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:32.951898+0000) 2021-08-03T12:40:32.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:32.956+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:32.956857+0000) 2021-08-03T12:40:33.176 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:33.170+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:33.172148+0000) 2021-08-03T12:40:33.294 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:33.242+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7637 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:33.571 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:33.564+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:33.566021+0000) 2021-08-03T12:40:33.702 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:33.696+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:33.698052+0000) 2021-08-03T12:40:33.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:33.956+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:33.956944+0000) 2021-08-03T12:40:34.693 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:34.673+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3411 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:34.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:34.956+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:34.957067+0000) 2021-08-03T12:40:35.341 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:35.192+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7642 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:35.557 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:35.553+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:35.553898+0000) 2021-08-03T12:40:36.558 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:36.553+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:36.554602+0000) 2021-08-03T12:40:37.263 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:40:37.259+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:37.260732+0000) 2021-08-03T12:40:37.558 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:37.554+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:37.555143+0000) 2021-08-03T12:40:37.958 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:37.951+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:37.952963+0000) 2021-08-03T12:40:37.975 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:37.969+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:37.971174+0000) 2021-08-03T12:40:38.211 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:38.206+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:38.208420+0000) 2021-08-03T12:40:38.464 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:38.457+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:38.459717+0000) 2021-08-03T12:40:38.471 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:38.466+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:38.466787+0000) 2021-08-03T12:40:38.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:38.535+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:38.537416+0000) 2021-08-03T12:40:38.559 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:38.554+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:38.555712+0000) 2021-08-03T12:40:39.269 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:39.264+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:39.266280+0000) 2021-08-03T12:40:39.465 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:39.460+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:39.462236+0000) 2021-08-03T12:40:39.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:39.535+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:39.537537+0000) 2021-08-03T12:40:39.560 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:39.555+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:39.556686+0000) 2021-08-03T12:40:40.467 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:40.462+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:40.464735+0000) 2021-08-03T12:40:40.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:40.535+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:40.537683+0000) 2021-08-03T12:40:40.560 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:40.556+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:40.557554+0000) 2021-08-03T12:40:41.287 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:40:41.281+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:41.282731+0000) 2021-08-03T12:40:41.403 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:41.367+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7642 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:41.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:41.465+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:41.467211+0000) 2021-08-03T12:40:41.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:41.536+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:41.537800+0000) 2021-08-03T12:40:41.561 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:41.557+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:41.558764+0000) 2021-08-03T12:40:41.651 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:41.645+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:41.647642+0000) 2021-08-03T12:40:41.737 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:41.732+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:41.733573+0000) 2021-08-03T12:40:41.831 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:41.771+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7637 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:42.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:42.465+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:42.467559+0000) 2021-08-03T12:40:42.543 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:42.536+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:42.537935+0000) 2021-08-03T12:40:42.658 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:42.653+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:42.655424+0000) 2021-08-03T12:40:42.737 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:42.733+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:42.734553+0000) 2021-08-03T12:40:42.945 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:42.941+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:42.942060+0000) 2021-08-03T12:40:43.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:43.465+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:43.467706+0000) 2021-08-03T12:40:43.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:43.536+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:43.538065+0000) 2021-08-03T12:40:43.739 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:43.734+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:43.735440+0000) 2021-08-03T12:40:43.796 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:43.789+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3418 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:43.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:43.795+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:43.797740+0000) 2021-08-03T12:40:43.946 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:43.941+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:43.942784+0000) 2021-08-03T12:40:44.166 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:44.162+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:44.163189+0000) 2021-08-03T12:40:44.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:44.466+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:44.467918+0000) 2021-08-03T12:40:44.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:44.536+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:44.538196+0000) 2021-08-03T12:40:44.946 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:44.942+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:44.943353+0000) 2021-08-03T12:40:45.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:45.467+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:45.468073+0000) 2021-08-03T12:40:45.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:45.536+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:45.538324+0000) 2021-08-03T12:40:45.577 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:45.570+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:45.572621+0000) 2021-08-03T12:40:45.947 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:45.943+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:45.943988+0000) 2021-08-03T12:40:46.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:46.467+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:46.468284+0000) 2021-08-03T12:40:46.488 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:46.483+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:46.484711+0000) 2021-08-03T12:40:46.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:46.537+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:46.538459+0000) 2021-08-03T12:40:46.948 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:46.943+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:46.944776+0000) 2021-08-03T12:40:47.044 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:47.039+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:47.039855+0000) 2021-08-03T12:40:47.436 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:47.430+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:47.431580+0000) 2021-08-03T12:40:47.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:47.467+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:47.468452+0000) 2021-08-03T12:40:47.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:47.537+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:47.538595+0000) 2021-08-03T12:40:47.948 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:47.944+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:47.945360+0000) 2021-08-03T12:40:48.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:48.188+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:48.189613+0000) 2021-08-03T12:40:48.214 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:40:48.211+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:48.212465+0000) 2021-08-03T12:40:48.467 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:48.447+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7637 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:48.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:48.467+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:48.468672+0000) 2021-08-03T12:40:48.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:48.537+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:48.538745+0000) 2021-08-03T12:40:48.949 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:48.945+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:48.946193+0000) 2021-08-03T12:40:49.031 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:48.916+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7642 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:49.136 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:40:49.129+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:49.130286+0000) 2021-08-03T12:40:49.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:49.468+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:49.468846+0000) 2021-08-03T12:40:49.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:49.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:49.538848+0000) 2021-08-03T12:40:49.951 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:49.946+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:49.947199+0000) 2021-08-03T12:40:50.105 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:50.094+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3420 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:50.166 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:40:50.161+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:50.162503+0000) 2021-08-03T12:40:50.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:50.468+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:50.469113+0000) 2021-08-03T12:40:50.503 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:50.498+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:50.499708+0000) 2021-08-03T12:40:50.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:50.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:50.539000+0000) 2021-08-03T12:40:50.768 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:40:50.764+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:50.765544+0000) 2021-08-03T12:40:50.951 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:50.947+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:50.948056+0000) 2021-08-03T12:40:51.299 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:51.294+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:51.295285+0000) 2021-08-03T12:40:51.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:51.468+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:51.469264+0000) 2021-08-03T12:40:51.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:51.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:51.539124+0000) 2021-08-03T12:40:51.726 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:51.720+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:51.721295+0000) 2021-08-03T12:40:51.952 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:51.947+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:51.948687+0000) 2021-08-03T12:40:52.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:52.468+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:52.469487+0000) 2021-08-03T12:40:52.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:52.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:52.539236+0000) 2021-08-03T12:40:52.826 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:52.823+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:52.823857+0000) 2021-08-03T12:40:52.828 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:52.825+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:52.826165+0000) 2021-08-03T12:40:52.952 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:52.948+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:52.949275+0000) 2021-08-03T12:40:53.382 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:53.376+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:53.377524+0000) 2021-08-03T12:40:53.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:53.468+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:53.469650+0000) 2021-08-03T12:40:53.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:53.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:53.539346+0000) 2021-08-03T12:40:53.953 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:53.949+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:53.950032+0000) 2021-08-03T12:40:54.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:54.469+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:54.469875+0000) 2021-08-03T12:40:54.531 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:40:54.416+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7646 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:40:54.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:54.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:54.539482+0000) 2021-08-03T12:40:54.903 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:40:54.749+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:54.750443+0000) 2021-08-03T12:40:54.954 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:54.950+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:54.950894+0000) 2021-08-03T12:40:55.137 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:40:54.877+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7637 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:40:55.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:55.469+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:55.470031+0000) 2021-08-03T12:40:55.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:55.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:55.539602+0000) 2021-08-03T12:40:55.954 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:55.950+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:55.951467+0000) 2021-08-03T12:40:56.387 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:40:56.023+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3420 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:40:56.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:56.469+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:56.470272+0000) 2021-08-03T12:40:56.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:56.538+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:56.539737+0000) 2021-08-03T12:40:56.955 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:56.951+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:56.952038+0000) 2021-08-03T12:40:57.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:57.469+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:57.470425+0000) 2021-08-03T12:40:57.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:57.539+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:57.539868+0000) 2021-08-03T12:40:57.660 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:57.656+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:57.657435+0000) 2021-08-03T12:40:57.858 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:40:57.852+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:57.853398+0000) 2021-08-03T12:40:57.955 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:57.951+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:57.952637+0000) 2021-08-03T12:40:58.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:58.469+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:58.470679+0000) 2021-08-03T12:40:58.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:58.539+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:58.539983+0000) 2021-08-03T12:40:58.678 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:40:58.667+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:58.667699+0000) 2021-08-03T12:40:58.760 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:58.756+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:58.757671+0000) 2021-08-03T12:40:58.956 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:58.952+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:58.953236+0000) 2021-08-03T12:40:59.067 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:40:59.063+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:59.063817+0000) 2021-08-03T12:40:59.354 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:40:59.349+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:59.349922+0000) 2021-08-03T12:40:59.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:40:59.470+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:59.470883+0000) 2021-08-03T12:40:59.755 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:40:59.750+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:59.751173+0000) 2021-08-03T12:40:59.957 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:40:59.953+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:40:59.954071+0000) 2021-08-03T12:41:00.330 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:00.326+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:00.327107+0000) 2021-08-03T12:41:00.958 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:00.953+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:00.954660+0000) 2021-08-03T12:41:01.266 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:01.261+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:01.262377+0000) 2021-08-03T12:41:01.313 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:01.289+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7637 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:01.793 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:01.726+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7668 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:01.958 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:01.954+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:01.955245+0000) 2021-08-03T12:41:02.810 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:02.806+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:02.807427+0000) 2021-08-03T12:41:02.959 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:02.955+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:02.955858+0000) 2021-08-03T12:41:03.170 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:03.167+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:03.168415+0000) 2021-08-03T12:41:03.960 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:03.956+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:03.956839+0000) 2021-08-03T12:41:04.194 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:04.189+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:04.190128+0000) 2021-08-03T12:41:04.595 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:04.591+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:04.592434+0000) 2021-08-03T12:41:04.960 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:04.956+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:04.957656+0000) 2021-08-03T12:41:05.382 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:05.376+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:05.377337+0000) 2021-08-03T12:41:05.587 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:05.372+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3431 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:05.961 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:05.957+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:05.958387+0000) 2021-08-03T12:41:06.962 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:06.958+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:06.958968+0000) 2021-08-03T12:41:07.427 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:07.422+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:07.423403+0000) 2021-08-03T12:41:07.743 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:07.508+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7647 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:07.963 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:07.958+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:07.959534+0000) 2021-08-03T12:41:08.964 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:08.959+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:08.960305+0000) 2021-08-03T12:41:09.648 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:09.642+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7685 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:09.691 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:09.685+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:09.686598+0000) 2021-08-03T12:41:09.910 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:09.905+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:09.906721+0000) 2021-08-03T12:41:09.964 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:09.960+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:09.960864+0000) 2021-08-03T12:41:10.755 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:10.750+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:10.751352+0000) 2021-08-03T12:41:10.911 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:10.906+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:10.907700+0000) 2021-08-03T12:41:10.964 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:10.960+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:10.961475+0000) 2021-08-03T12:41:11.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:11.012+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:11.013454+0000) 2021-08-03T12:41:11.708 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:11.703+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:11.704411+0000) 2021-08-03T12:41:11.912 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:11.907+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:11.908535+0000) 2021-08-03T12:41:11.965 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:11.961+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:11.962350+0000) 2021-08-03T12:41:12.065 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:12.061+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:12.062479+0000) 2021-08-03T12:41:12.264 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:12.240+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3435 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:12.268 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:12.261+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:12.262701+0000) 2021-08-03T12:41:12.567 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:12.563+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:12.563942+0000) 2021-08-03T12:41:12.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:12.625+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:12.626005+0000) 2021-08-03T12:41:12.807 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:12.803+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:12.804457+0000) 2021-08-03T12:41:12.912 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:12.908+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:12.909133+0000) 2021-08-03T12:41:12.968 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:12.962+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:12.962992+0000) 2021-08-03T12:41:13.577 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:13.566+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:13.567151+0000) 2021-08-03T12:41:13.810 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:13.806+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:13.807053+0000) 2021-08-03T12:41:13.913 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:13.909+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:13.909911+0000) 2021-08-03T12:41:14.442 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:14.436+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:14.437299+0000) 2021-08-03T12:41:14.578 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:14.574+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:14.574838+0000) 2021-08-03T12:41:14.645 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:14.642+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:14.643058+0000) 2021-08-03T12:41:14.812 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:14.808+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:14.809669+0000) 2021-08-03T12:41:15.292 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:15.286+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:15.578 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:15.574+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:15.575435+0000) 2021-08-03T12:41:15.806 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:15.775+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7691 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:15.812 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:15.809+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:15.810022+0000) 2021-08-03T12:41:16.008 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:16.004+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:16.005020+0000) 2021-08-03T12:41:16.813 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:16.809+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:16.810259+0000) 2021-08-03T12:41:17.549 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:17.544+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:17.544788+0000) 2021-08-03T12:41:17.813 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:17.809+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:17.810412+0000) 2021-08-03T12:41:18.591 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:18.586+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:18.587551+0000) 2021-08-03T12:41:19.402 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:19.398+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:19.399076+0000) 2021-08-03T12:41:19.454 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:19.449+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:19.450074+0000) 2021-08-03T12:41:20.083 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:20.078+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:20.078763+0000) 2021-08-03T12:41:20.230 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:20.225+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:20.226152+0000) 2021-08-03T12:41:20.624 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:20.620+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:20.620984+0000) 2021-08-03T12:41:21.410 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:21.375+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:21.468 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:21.447+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7695 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:21.472 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:21.467+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:21.468124+0000) 2021-08-03T12:41:21.536 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:21.532+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:21.533806+0000) 2021-08-03T12:41:21.625 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:21.621+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:21.621908+0000) 2021-08-03T12:41:22.626 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:22.621+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:22.622475+0000) 2021-08-03T12:41:23.627 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:23.622+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:23.623546+0000) 2021-08-03T12:41:23.760 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:23.481+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3445 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:24.991 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:24.986+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:24.986998+0000) 2021-08-03T12:41:25.502 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:25.498+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:25.499020+0000) 2021-08-03T12:41:25.960 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:25.956+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:25.957695+0000) 2021-08-03T12:41:26.161 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:26.156+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:26.157212+0000) 2021-08-03T12:41:26.265 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:26.261+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:26.262345+0000) 2021-08-03T12:41:26.567 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:26.561+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7701 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:26.573 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:26.569+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:26.570130+0000) 2021-08-03T12:41:28.698 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:28.646+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:28.884 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:28.879+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:28.881104+0000) 2021-08-03T12:41:29.061 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:29.055+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:29.057271+0000) 2021-08-03T12:41:29.399 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:29.392+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:29.394485+0000) 2021-08-03T12:41:30.233 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:29.902+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3449 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:31.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:31.251+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:31.253790+0000) 2021-08-03T12:41:31.460 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:31.455+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:31.457665+0000) 2021-08-03T12:41:31.630 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:31.624+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:31.625250+0000) 2021-08-03T12:41:31.675 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:31.587+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7707 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:31.876 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:31.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:31.873850+0000) 2021-08-03T12:41:31.999 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:31.994+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:31.996429+0000) 2021-08-03T12:41:32.147 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:32.142+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:32.144243+0000) 2021-08-03T12:41:32.659 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:32.653+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:32.655620+0000) 2021-08-03T12:41:32.847 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:32.843+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:32.844028+0000) 2021-08-03T12:41:32.851 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:32.846+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:32.848558+0000) 2021-08-03T12:41:32.876 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:32.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:32.873986+0000) 2021-08-03T12:41:33.043 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:33.040+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:33.040906+0000) 2021-08-03T12:41:33.151 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:33.146+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:33.148291+0000) 2021-08-03T12:41:33.331 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:33.325+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:33.327251+0000) 2021-08-03T12:41:33.659 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:33.654+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:33.656291+0000) 2021-08-03T12:41:33.848 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:33.844+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:33.845020+0000) 2021-08-03T12:41:33.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:33.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:33.874116+0000) 2021-08-03T12:41:34.154 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:34.150+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:34.151852+0000) 2021-08-03T12:41:34.355 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:34.351+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:34.352128+0000) 2021-08-03T12:41:34.549 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:34.241+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:34.660 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:34.655+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:34.657275+0000) 2021-08-03T12:41:34.742 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:34.737+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:34.738237+0000) 2021-08-03T12:41:34.849 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:34.844+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:34.845748+0000) 2021-08-03T12:41:34.876 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:34.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:34.874223+0000) 2021-08-03T12:41:35.117 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:35.112+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:35.112864+0000) 2021-08-03T12:41:35.155 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:35.150+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:35.152243+0000) 2021-08-03T12:41:35.356 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:35.352+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:35.352873+0000) 2021-08-03T12:41:35.477 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:35.470+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:35.472344+0000) 2021-08-03T12:41:35.661 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:35.656+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:35.657875+0000) 2021-08-03T12:41:35.849 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:35.845+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:35.846387+0000) 2021-08-03T12:41:35.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:35.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:35.874360+0000) 2021-08-03T12:41:36.093 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:36.088+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:36.088926+0000) 2021-08-03T12:41:36.155 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:36.151+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:36.152395+0000) 2021-08-03T12:41:36.307 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:36.302+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:36.302863+0000) 2021-08-03T12:41:36.356 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:36.352+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:36.353730+0000) 2021-08-03T12:41:36.661 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:36.657+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:36.658436+0000) 2021-08-03T12:41:36.743 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:36.536+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3451 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:36.850 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:36.846+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:36.847639+0000) 2021-08-03T12:41:37.155 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:37.151+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:37.152591+0000) 2021-08-03T12:41:37.360 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:37.352+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:37.354354+0000) 2021-08-03T12:41:37.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:37.470+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:37.471349+0000) 2021-08-03T12:41:37.662 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:37.658+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:37.658830+0000) 2021-08-03T12:41:37.852 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:37.846+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:37.848720+0000) 2021-08-03T12:41:38.498 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:38.491+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:38.493531+0000) 2021-08-03T12:41:38.537 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:38.428+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7729 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:38.663 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:38.658+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:38.659411+0000) 2021-08-03T12:41:38.852 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:38.847+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:38.849319+0000) 2021-08-03T12:41:39.663 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:39.659+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:39.659942+0000) 2021-08-03T12:41:39.853 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:39.848+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:39.849975+0000) 2021-08-03T12:41:40.663 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:40.660+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:40.661010+0000) 2021-08-03T12:41:40.664 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:40.659+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:40.660579+0000) 2021-08-03T12:41:40.854 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:40.848+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:40.850593+0000) 2021-08-03T12:41:40.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:40.859+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:40.860810+0000) 2021-08-03T12:41:41.075 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:41.070+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:41.072610+0000) 2021-08-03T12:41:41.076 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:41.007+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:41.526 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:41.522+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:41.523631+0000) 2021-08-03T12:41:41.664 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:41.660+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:41.661397+0000) 2021-08-03T12:41:41.854 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:41.849+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:41.851161+0000) 2021-08-03T12:41:41.989 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:41.982+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:41.984484+0000) 2021-08-03T12:41:42.119 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:42.113+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:42.114490+0000) 2021-08-03T12:41:42.442 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:42.438+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:42.439709+0000) 2021-08-03T12:41:42.665 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:42.661+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:42.661956+0000) 2021-08-03T12:41:42.788 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:42.783+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:42.784547+0000) 2021-08-03T12:41:42.855 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:42.849+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:42.851766+0000) 2021-08-03T12:41:43.442 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:43.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:43.439881+0000) 2021-08-03T12:41:43.666 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:43.661+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:43.662627+0000) 2021-08-03T12:41:43.855 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:43.850+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:43.852515+0000) 2021-08-03T12:41:44.442 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:44.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:44.439999+0000) 2021-08-03T12:41:44.666 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:44.662+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:44.663185+0000) 2021-08-03T12:41:44.856 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:44.851+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:44.853102+0000) 2021-08-03T12:41:44.917 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:44.911+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:44.913448+0000) 2021-08-03T12:41:45.187 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:45.181+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7759 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:45.275 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:45.205+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3455 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:45.321 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:45.315+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:45.316658+0000) 2021-08-03T12:41:45.857 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:45.853+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:45.853895+0000) 2021-08-03T12:41:46.584 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:46.580+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:46.581047+0000) 2021-08-03T12:41:46.857 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:46.853+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:46.854451+0000) 2021-08-03T12:41:47.171 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:47.151+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:47.176 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:47.172+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:47.172733+0000) 2021-08-03T12:41:47.279 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:47.274+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:47.274819+0000) 2021-08-03T12:41:47.858 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:47.854+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:47.854998+0000) 2021-08-03T12:41:48.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:48.775+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:48.776044+0000) 2021-08-03T12:41:48.821 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:48.816+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:48.817631+0000) 2021-08-03T12:41:48.859 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:48.854+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:48.855584+0000) 2021-08-03T12:41:49.009 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:49.005+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:49.005810+0000) 2021-08-03T12:41:49.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:49.145+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:49.146414+0000) 2021-08-03T12:41:49.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:49.637+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:49.638100+0000) 2021-08-03T12:41:49.664 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:49.659+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:49.659695+0000) 2021-08-03T12:41:49.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:49.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:49.701515+0000) 2021-08-03T12:41:49.859 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:49.855+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:49.856198+0000) 2021-08-03T12:41:50.009 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:50.005+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:50.006476+0000) 2021-08-03T12:41:50.215 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:50.209+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:50.210353+0000) 2021-08-03T12:41:50.492 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:50.486+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:50.487251+0000) 2021-08-03T12:41:50.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:50.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:50.701664+0000) 2021-08-03T12:41:50.860 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:50.856+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:50.856815+0000) 2021-08-03T12:41:51.011 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:51.006+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:51.007313+0000) 2021-08-03T12:41:51.103 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:50.510+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7768 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:51.489 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:51.485+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:51.486317+0000) 2021-08-03T12:41:51.631 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:51.624+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3456 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:51.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:51.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:51.701793+0000) 2021-08-03T12:41:51.850 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:51.845+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:51.846256+0000) 2021-08-03T12:41:51.860 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:51.856+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:51.857375+0000) 2021-08-03T12:41:52.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:52.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:52.701937+0000) 2021-08-03T12:41:52.861 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:52.856+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:52.857790+0000) 2021-08-03T12:41:52.974 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:52.968+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:52.969697+0000) 2021-08-03T12:41:53.471 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:41:53.466+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:53.467084+0000) 2021-08-03T12:41:53.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:53.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:53.702062+0000) 2021-08-03T12:41:53.862 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:53.857+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:53.858535+0000) 2021-08-03T12:41:54.052 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:41:53.939+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:41:54.260 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:41:54.255+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:54.256736+0000) 2021-08-03T12:41:54.550 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:54.545+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:54.546102+0000) 2021-08-03T12:41:54.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:54.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:54.702201+0000) 2021-08-03T12:41:54.862 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:54.858+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:54.859130+0000) 2021-08-03T12:41:54.969 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:54.965+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:54.966339+0000) 2021-08-03T12:41:55.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:55.341+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:55.342463+0000) 2021-08-03T12:41:55.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:55.588+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:55.589699+0000) 2021-08-03T12:41:55.627 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:55.622+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:55.623379+0000) 2021-08-03T12:41:55.863 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:55.858+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:55.859734+0000) 2021-08-03T12:41:56.245 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:41:56.074+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7788 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:41:56.361 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:41:56.355+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.356699+0000) 2021-08-03T12:41:56.778 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:41:56.773+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.774627+0000) 2021-08-03T12:41:56.811 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:56.775+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.776648+0000) 2021-08-03T12:41:56.863 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:56.859+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.860565+0000) 2021-08-03T12:41:56.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:56.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.874709+0000) 2021-08-03T12:41:56.960 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:56.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.958068+0000) 2021-08-03T12:41:56.969 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:41:56.963+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.964095+0000) 2021-08-03T12:41:56.972 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:41:56.969+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:56.970028+0000) 2021-08-03T12:41:57.033 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:57.029+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:57.030278+0000) 2021-08-03T12:41:57.869 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:57.865+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:57.866190+0000) 2021-08-03T12:41:57.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:57.874+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:57.874862+0000) 2021-08-03T12:41:57.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:57.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:57.958204+0000) 2021-08-03T12:41:58.678 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:58.674+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:58.674882+0000) 2021-08-03T12:41:58.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:58.874+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:58.874978+0000) 2021-08-03T12:41:58.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:58.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:58.958326+0000) 2021-08-03T12:41:59.122 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:41:58.386+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3456 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:41:59.530 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:41:59.525+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:59.525968+0000) 2021-08-03T12:41:59.679 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:41:59.674+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:59.675597+0000) 2021-08-03T12:41:59.731 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:41:59.726+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:59.727036+0000) 2021-08-03T12:41:59.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:59.874+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:59.875158+0000) 2021-08-03T12:41:59.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:41:59.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:41:59.958461+0000) 2021-08-03T12:42:00.680 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:00.675+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:00.676540+0000) 2021-08-03T12:42:00.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:00.874+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:00.875301+0000) 2021-08-03T12:42:01.315 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:01.310+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:01.311288+0000) 2021-08-03T12:42:01.380 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:01.376+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:01.376879+0000) 2021-08-03T12:42:01.394 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:01.305+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:01.626 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:01.596+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7792 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:01.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:01.874+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:01.875002+0000) 2021-08-03T12:42:01.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:01.874+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:01.875417+0000) 2021-08-03T12:42:02.052 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:02.046+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:02.047152+0000) 2021-08-03T12:42:02.053 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:02.048+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:02.049523+0000) 2021-08-03T12:42:03.269 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:03.264+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:03.265156+0000) 2021-08-03T12:42:03.287 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:03.283+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:03.284651+0000) 2021-08-03T12:42:03.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:03.392+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:03.392867+0000) 2021-08-03T12:42:03.681 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:03.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:03.677626+0000) 2021-08-03T12:42:03.827 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:03.822+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:03.823458+0000) 2021-08-03T12:42:04.456 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:04.452+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:04.453726+0000) 2021-08-03T12:42:04.598 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:04.593+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:04.594169+0000) 2021-08-03T12:42:04.681 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:04.677+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:04.678411+0000) 2021-08-03T12:42:04.983 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:04.978+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:04.978979+0000) 2021-08-03T12:42:04.984 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:04.978+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:04.979794+0000) 2021-08-03T12:42:05.245 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:42:04.593+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3465 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:42:05.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:05.436+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:05.437124+0000) 2021-08-03T12:42:05.669 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:05.665+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:05.666436+0000) 2021-08-03T12:42:05.682 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:05.678+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:05.678985+0000) 2021-08-03T12:42:05.825 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:05.821+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:05.822321+0000) 2021-08-03T12:42:06.050 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:06.046+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:06.047701+0000) 2021-08-03T12:42:06.671 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:06.666+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:06.667469+0000) 2021-08-03T12:42:06.682 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:06.678+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:06.679569+0000) 2021-08-03T12:42:06.716 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:06.696+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:07.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:07.506+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:07.506835+0000) 2021-08-03T12:42:07.683 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:07.679+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:07.680178+0000) 2021-08-03T12:42:07.995 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:07.990+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:07.991379+0000) 2021-08-03T12:42:08.680 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:08.675+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:08.676455+0000) 2021-08-03T12:42:08.684 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:08.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:08.681102+0000) 2021-08-03T12:42:08.689 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:08.684+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:08.685451+0000) 2021-08-03T12:42:08.996 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:08.991+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:08.992478+0000) 2021-08-03T12:42:09.302 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:09.220+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7829 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:09.608 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:09.604+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:09.605187+0000) 2021-08-03T12:42:09.996 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:09.992+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:09.993307+0000) 2021-08-03T12:42:10.027 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:10.023+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:10.024777+0000) 2021-08-03T12:42:10.555 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:10.551+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:10.552782+0000) 2021-08-03T12:42:10.997 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:10.993+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:10.993881+0000) 2021-08-03T12:42:10.998 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:10.992+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:10.993517+0000) 2021-08-03T12:42:11.830 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:11.826+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:11.827640+0000) 2021-08-03T12:42:11.836 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:11.832+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:11.833637+0000) 2021-08-03T12:42:11.998 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:11.994+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:11.994837+0000) 2021-08-03T12:42:12.342 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:12.337+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:12.338387+0000) 2021-08-03T12:42:12.999 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:12.994+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:12.995472+0000) 2021-08-03T12:42:13.461 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:13.456+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:13.457146+0000) 2021-08-03T12:42:13.543 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:13.502+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:13.999 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:13.995+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:13.996288+0000) 2021-08-03T12:42:14.276 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:42:14.245+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3478 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:42:14.889 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:14.884+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7829 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:14.925 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:14.922+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:14.922890+0000) 2021-08-03T12:42:15.425 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:15.421+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:15.422051+0000) 2021-08-03T12:42:15.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:15.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:15.440374+0000) 2021-08-03T12:42:15.454 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:15.448+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:15.449439+0000) 2021-08-03T12:42:15.687 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:15.683+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:15.684730+0000) 2021-08-03T12:42:15.923 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:15.918+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:15.919362+0000) 2021-08-03T12:42:16.118 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:16.114+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:16.115762+0000) 2021-08-03T12:42:16.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:16.244+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:16.245411+0000) 2021-08-03T12:42:16.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:16.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:16.440534+0000) 2021-08-03T12:42:16.923 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:16.919+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:16.920366+0000) 2021-08-03T12:42:17.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:17.438+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:17.440672+0000) 2021-08-03T12:42:17.592 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:17.587+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:17.588483+0000) 2021-08-03T12:42:17.649 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:17.644+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:17.645601+0000) 2021-08-03T12:42:17.657 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:17.652+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:17.653753+0000) 2021-08-03T12:42:17.924 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:17.920+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:17.920981+0000) 2021-08-03T12:42:17.947 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:17.941+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:17.942811+0000) 2021-08-03T12:42:18.169 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:18.166+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:18.167333+0000) 2021-08-03T12:42:18.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:18.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:18.440809+0000) 2021-08-03T12:42:18.481 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:18.476+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:18.477123+0000) 2021-08-03T12:42:18.592 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:18.588+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:18.589198+0000) 2021-08-03T12:42:18.925 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:18.920+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:18.921576+0000) 2021-08-03T12:42:18.948 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:18.942+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7648 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:19.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:19.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:19.440937+0000) 2021-08-03T12:42:19.593 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:19.588+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:19.589775+0000) 2021-08-03T12:42:19.850 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:19.844+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:19.845973+0000) 2021-08-03T12:42:19.925 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:19.921+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:19.922369+0000) 2021-08-03T12:42:20.066 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:20.059+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:20.061708+0000) 2021-08-03T12:42:20.163 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:20.158+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:20.160187+0000) 2021-08-03T12:42:20.197 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:42:20.191+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3481 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:42:20.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:20.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:20.441093+0000) 2021-08-03T12:42:20.594 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:20.589+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:20.590363+0000) 2021-08-03T12:42:20.926 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:20.922+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:20.922981+0000) 2021-08-03T12:42:21.066 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:21.060+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:21.062138+0000) 2021-08-03T12:42:21.166 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:21.161+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:21.163739+0000) 2021-08-03T12:42:21.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:21.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:21.441225+0000) 2021-08-03T12:42:21.594 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:21.590+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:21.590988+0000) 2021-08-03T12:42:21.927 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:21.922+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:21.923606+0000) 2021-08-03T12:42:22.014 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:22.009+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:22.011154+0000) 2021-08-03T12:42:22.168 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:22.164+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:22.166032+0000) 2021-08-03T12:42:22.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:22.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:22.441341+0000) 2021-08-03T12:42:22.595 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:22.590+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:22.591565+0000) 2021-08-03T12:42:22.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:22.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:22.875789+0000) 2021-08-03T12:42:22.928 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:22.924+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:22.925215+0000) 2021-08-03T12:42:23.015 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:23.010+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:23.011866+0000) 2021-08-03T12:42:23.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:23.164+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:23.166486+0000) 2021-08-03T12:42:23.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:23.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:23.441500+0000) 2021-08-03T12:42:23.599 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:23.591+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:23.592159+0000) 2021-08-03T12:42:23.615 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:23.609+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7857 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:23.930 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:23.925+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:23.926615+0000) 2021-08-03T12:42:24.016 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:24.010+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:24.012454+0000) 2021-08-03T12:42:24.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:24.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:24.441631+0000) 2021-08-03T12:42:24.637 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:24.630+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:24.631943+0000) 2021-08-03T12:42:24.877 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:24.872+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:24.873709+0000) 2021-08-03T12:42:24.928 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:24.921+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:24.923347+0000) 2021-08-03T12:42:24.930 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:24.926+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:24.927256+0000) 2021-08-03T12:42:24.932 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:24.928+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:24.930171+0000) 2021-08-03T12:42:25.129 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:25.125+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:25.125961+0000) 2021-08-03T12:42:25.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:25.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:25.441788+0000) 2021-08-03T12:42:25.621 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:25.444+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7650 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:25.640 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:25.635+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:25.637562+0000) 2021-08-03T12:42:25.878 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:25.873+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:25.874666+0000) 2021-08-03T12:42:25.931 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:25.927+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:25.928401+0000) 2021-08-03T12:42:26.130 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:26.126+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:26.127306+0000) 2021-08-03T12:42:26.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:26.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:26.441910+0000) 2021-08-03T12:42:26.878 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:26.874+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:26.875300+0000) 2021-08-03T12:42:26.933 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:26.929+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:26.930383+0000) 2021-08-03T12:42:27.131 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:27.127+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:27.128235+0000) 2021-08-03T12:42:27.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:27.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:27.442019+0000) 2021-08-03T12:42:27.879 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:27.875+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:27.875926+0000) 2021-08-03T12:42:27.934 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:27.930+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:27.931220+0000) 2021-08-03T12:42:28.134 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:28.128+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:28.129237+0000) 2021-08-03T12:42:28.392 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:28.389+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:28.390261+0000) 2021-08-03T12:42:28.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:28.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:28.442145+0000) 2021-08-03T12:42:28.651 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:28.646+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:28.647262+0000) 2021-08-03T12:42:28.796 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:28.779+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7876 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:28.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:28.857+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:28.858415+0000) 2021-08-03T12:42:28.880 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:28.875+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:28.876733+0000) 2021-08-03T12:42:28.935 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:28.931+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:28.931895+0000) 2021-08-03T12:42:29.134 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:29.129+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:29.130650+0000) 2021-08-03T12:42:29.208 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:29.203+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:29.204047+0000) 2021-08-03T12:42:29.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:29.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:29.442303+0000) 2021-08-03T12:42:29.880 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:29.876+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:29.877305+0000) 2021-08-03T12:42:29.936 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:29.931+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:29.932773+0000) 2021-08-03T12:42:30.135 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:30.131+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:30.131800+0000) 2021-08-03T12:42:30.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:30.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:30.442468+0000) 2021-08-03T12:42:30.601 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:42:30.362+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3484 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:42:30.881 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:30.877+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:30.877921+0000) 2021-08-03T12:42:30.936 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:30.932+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:30.933362+0000) 2021-08-03T12:42:31.136 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:31.131+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:31.132722+0000) 2021-08-03T12:42:31.176 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:31.171+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:31.172724+0000) 2021-08-03T12:42:31.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:31.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:31.442616+0000) 2021-08-03T12:42:31.684 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:31.679+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:31.680383+0000) 2021-08-03T12:42:31.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:31.864+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:31.865013+0000) 2021-08-03T12:42:31.882 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:31.877+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:31.878539+0000) 2021-08-03T12:42:31.937 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:31.933+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:31.934377+0000) 2021-08-03T12:42:32.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:32.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:32.442755+0000) 2021-08-03T12:42:32.684 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:32.680+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:32.681076+0000) 2021-08-03T12:42:32.938 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:32.934+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:32.935209+0000) 2021-08-03T12:42:32.986 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:32.690+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7656 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:33.301 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:33.295+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:33.296550+0000) 2021-08-03T12:42:33.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:33.442+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:33.442876+0000) 2021-08-03T12:42:33.939 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:33.935+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:33.935794+0000) 2021-08-03T12:42:34.110 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:34.106+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:34.107837+0000) 2021-08-03T12:42:34.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:34.442+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:34.443035+0000) 2021-08-03T12:42:34.793 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:34.788+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:34.789186+0000) 2021-08-03T12:42:34.940 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:34.935+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:34.936710+0000) 2021-08-03T12:42:35.341 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:35.335+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:35.336588+0000) 2021-08-03T12:42:35.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:35.442+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:35.443187+0000) 2021-08-03T12:42:35.941 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:35.936+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:35.937554+0000) 2021-08-03T12:42:36.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:36.442+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:36.443310+0000) 2021-08-03T12:42:36.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:36.702+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:36.703668+0000) 2021-08-03T12:42:36.927 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:42:36.883+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3490 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:42:36.942 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:36.937+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:36.938550+0000) 2021-08-03T12:42:37.000 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:36.995+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:36.995953+0000) 2021-08-03T12:42:37.225 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:37.205+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7889 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:37.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:37.442+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:37.443462+0000) 2021-08-03T12:42:37.942 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:37.938+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:37.939080+0000) 2021-08-03T12:42:38.377 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:38.372+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:38.373314+0000) 2021-08-03T12:42:38.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:38.442+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:38.443610+0000) 2021-08-03T12:42:38.829 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:38.824+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:38.825069+0000) 2021-08-03T12:42:39.054 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:39.051+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:39.052055+0000) 2021-08-03T12:42:39.254 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:39.239+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7681 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:39.353 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:39.348+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:39.349172+0000) 2021-08-03T12:42:40.765 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:40.761+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:40.762130+0000) 2021-08-03T12:42:41.230 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:41.224+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:41.225667+0000) 2021-08-03T12:42:41.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:41.386+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:41.387075+0000) 2021-08-03T12:42:42.289 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:42.285+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:42.286276+0000) 2021-08-03T12:42:42.292 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:42.287+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:42.288173+0000) 2021-08-03T12:42:43.099 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:43.095+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:43.096371+0000) 2021-08-03T12:42:43.127 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:43.122+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:43.122980+0000) 2021-08-03T12:42:43.570 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:43.347+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7896 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:43.879 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:43.875+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:43.876212+0000) 2021-08-03T12:42:44.879 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:44.875+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:44.876376+0000) 2021-08-03T12:42:45.119 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:45.114+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:45.115667+0000) 2021-08-03T12:42:45.676 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:42:45.249+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3495 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:42:45.879 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:45.875+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:45.876518+0000) 2021-08-03T12:42:46.879 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:46.875+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:46.876676+0000) 2021-08-03T12:42:46.946 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:46.940+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:46.941731+0000) 2021-08-03T12:42:47.954 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:47.949+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:47.950390+0000) 2021-08-03T12:42:48.102 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:47.897+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7696 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:49.108 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:49.104+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:49.105305+0000) 2021-08-03T12:42:49.508 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:42:49.502+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:49.504427+0000) 2021-08-03T12:42:49.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:49.575+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:49.576656+0000) 2021-08-03T12:42:49.748 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:49.702+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:50.139 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:50.133+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:50.134403+0000) 2021-08-03T12:42:50.312 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:42:50.305+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:50.307107+0000) 2021-08-03T12:42:50.314 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:50.309+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:50.311473+0000) 2021-08-03T12:42:50.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:50.331+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:50.332411+0000) 2021-08-03T12:42:50.574 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:50.570+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:50.571676+0000) 2021-08-03T12:42:50.577 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:50.570+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:50.572500+0000) 2021-08-03T12:42:51.947 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:42:51.942+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:51.943285+0000) 2021-08-03T12:42:51.950 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:51.945+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:51.945840+0000) 2021-08-03T12:42:52.280 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:52.274+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:52.276749+0000) 2021-08-03T12:42:52.780 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:52.776+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:52.777306+0000) 2021-08-03T12:42:53.280 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:53.275+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:53.277423+0000) 2021-08-03T12:42:53.780 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:53.776+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:53.777471+0000) 2021-08-03T12:42:53.901 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:42:53.713+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7706 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:42:54.375 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:54.370+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:54.371248+0000) 2021-08-03T12:42:54.473 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:42:54.107+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:42:55.807 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:55.803+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:55.804559+0000) 2021-08-03T12:42:56.299 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:56.294+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:56.295679+0000) 2021-08-03T12:42:56.645 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:56.640+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:56.641606+0000) 2021-08-03T12:42:57.336 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:42:57.330+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:57.331414+0000) 2021-08-03T12:42:57.552 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:57.548+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:57.549567+0000) 2021-08-03T12:42:57.646 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:57.641+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:57.642366+0000) 2021-08-03T12:42:57.679 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:57.674+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:57.675493+0000) 2021-08-03T12:42:58.321 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:42:58.037+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7922 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:42:58.646 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:58.642+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:58.642953+0000) 2021-08-03T12:42:58.701 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:58.686+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:58.686800+0000) 2021-08-03T12:42:58.956 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:58.952+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:58.953170+0000) 2021-08-03T12:42:59.167 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:42:59.162+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:59.162796+0000) 2021-08-03T12:42:59.503 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:42:59.500+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:59.501089+0000) 2021-08-03T12:42:59.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:42:59.505+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:59.506767+0000) 2021-08-03T12:42:59.516 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:42:59.511+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:59.511952+0000) 2021-08-03T12:42:59.647 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:42:59.643+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:59.643920+0000) 2021-08-03T12:42:59.691 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:42:59.686+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:42:59.687622+0000) 2021-08-03T12:43:00.309 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:43:00.303+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:00.304695+0000) 2021-08-03T12:43:00.584 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:00.487+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7711 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:00.648 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:00.643+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:00.644526+0000) 2021-08-03T12:43:00.692 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:43:00.687+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:00.688211+0000) 2021-08-03T12:43:00.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:00.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:00.959050+0000) 2021-08-03T12:43:01.693 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:43:01.688+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:01.689412+0000) 2021-08-03T12:43:01.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:01.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:01.959175+0000) 2021-08-03T12:43:03.584 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:43:03.245+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:43:04.120 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:04.116+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:04.117444+0000) 2021-08-03T12:43:04.912 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:04.906+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:04.907223+0000) 2021-08-03T12:43:04.947 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:04.911+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7944 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:05.749 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:05.745+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:05.746449+0000) 2021-08-03T12:43:06.092 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:43:06.086+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:06.087694+0000) 2021-08-03T12:43:07.208 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:07.199+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:07.201130+0000) 2021-08-03T12:43:07.463 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:07.458+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:07.459919+0000) 2021-08-03T12:43:07.618 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:07.613+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:07.614609+0000) 2021-08-03T12:43:08.031 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:08.023+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7723 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:08.113 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:08.109+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:08.111191+0000) 2021-08-03T12:43:08.771 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:08.768+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:08.769126+0000) 2021-08-03T12:43:08.851 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:08.846+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:08.848544+0000) 2021-08-03T12:43:09.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:09.540+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:09.542233+0000) 2021-08-03T12:43:09.871 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:09.866+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:09.866820+0000) 2021-08-03T12:43:10.855 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:10.850+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:10.851003+0000) 2021-08-03T12:43:10.863 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:10.859+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:10.859939+0000) 2021-08-03T12:43:11.864 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:11.860+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:11.861277+0000) 2021-08-03T12:43:11.962 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:11.958+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7948 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:12.161 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:43:12.156+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:12.157374+0000) 2021-08-03T12:43:12.866 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:12.861+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:12.862479+0000) 2021-08-03T12:43:12.873 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:12.869+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:12.871079+0000) 2021-08-03T12:43:13.495 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:13.489+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:13.490866+0000) 2021-08-03T12:43:13.613 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:13.573+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7746 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:13.867 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:13.862+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:13.863644+0000) 2021-08-03T12:43:13.932 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:13.928+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:13.930194+0000) 2021-08-03T12:43:13.952 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:43:13.613+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:43:14.513 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:14.509+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:14.510906+0000) 2021-08-03T12:43:14.662 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:14.655+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:14.657166+0000) 2021-08-03T12:43:14.868 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:14.863+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:14.864587+0000) 2021-08-03T12:43:15.221 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:15.215+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:15.217609+0000) 2021-08-03T12:43:15.865 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:15.862+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:15.862975+0000) 2021-08-03T12:43:15.869 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:15.865+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:15.865906+0000) 2021-08-03T12:43:16.870 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:16.866+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:16.867068+0000) 2021-08-03T12:43:16.961 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:16.955+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:16.956318+0000) 2021-08-03T12:43:17.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:17.394+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:17.395437+0000) 2021-08-03T12:43:17.871 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:17.867+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:17.868033+0000) 2021-08-03T12:43:18.872 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:18.868+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:18.868960+0000) 2021-08-03T12:43:19.873 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:19.869+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:19.869870+0000) 2021-08-03T12:43:20.201 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:20.125+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7948 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:20.875 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:20.870+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:20.870822+0000) 2021-08-03T12:43:21.876 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:21.871+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:21.872158+0000) 2021-08-03T12:43:21.957 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:21.953+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:21.954061+0000) 2021-08-03T12:43:22.575 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:43:22.234+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:43:22.730 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:22.726+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7786 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:22.876 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:22.872+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:22.873151+0000) 2021-08-03T12:43:22.958 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:22.954+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:22.954813+0000) 2021-08-03T12:43:23.877 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:23.873+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:23.874393+0000) 2021-08-03T12:43:23.903 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:23.899+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:23.900040+0000) 2021-08-03T12:43:23.959 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:23.955+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:23.955842+0000) 2021-08-03T12:43:24.879 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:24.875+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:24.875891+0000) 2021-08-03T12:43:24.960 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:24.955+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:24.956487+0000) 2021-08-03T12:43:25.023 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:25.019+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:25.020418+0000) 2021-08-03T12:43:25.215 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:25.212+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:25.213099+0000) 2021-08-03T12:43:25.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:25.521+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:25.522033+0000) 2021-08-03T12:43:25.558 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:25.555+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:25.556046+0000) 2021-08-03T12:43:25.705 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:25.702+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:25.703173+0000) 2021-08-03T12:43:25.880 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:25.876+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:25.876822+0000) 2021-08-03T12:43:25.960 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:25.956+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:25.957067+0000) 2021-08-03T12:43:26.027 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:26.022+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:26.023147+0000) 2021-08-03T12:43:26.402 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:26.398+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:26.399528+0000) 2021-08-03T12:43:26.438 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:26.380+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7948 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:26.705 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:43:26.700+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:26.701417+0000) 2021-08-03T12:43:26.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:26.702+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:26.703321+0000) 2021-08-03T12:43:26.881 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:26.876+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:26.877716+0000) 2021-08-03T12:43:26.961 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:26.957+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:26.958152+0000) 2021-08-03T12:43:27.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:27.702+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:27.703511+0000) 2021-08-03T12:43:27.882 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:27.877+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:27.878684+0000) 2021-08-03T12:43:27.962 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:27.958+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:27.959007+0000) 2021-08-03T12:43:28.075 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:28.071+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.072583+0000) 2021-08-03T12:43:28.187 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:28.181+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.182218+0000) 2021-08-03T12:43:28.433 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:28.428+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.429251+0000) 2021-08-03T12:43:28.456 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:28.451+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.452513+0000) 2021-08-03T12:43:28.532 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:28.424+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7797 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:28.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:28.702+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.703667+0000) 2021-08-03T12:43:28.882 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:28.878+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.879673+0000) 2021-08-03T12:43:28.950 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:28.947+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.948252+0000) 2021-08-03T12:43:28.963 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:28.959+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:28.959818+0000) 2021-08-03T12:43:29.022 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:29.018+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:29.019399+0000) 2021-08-03T12:43:29.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:29.702+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:29.703821+0000) 2021-08-03T12:43:29.884 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:29.880+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:29.880929+0000) 2021-08-03T12:43:29.963 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:29.959+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:29.960417+0000) 2021-08-03T12:43:30.353 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:30.348+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:30.349732+0000) 2021-08-03T12:43:30.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:30.703+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:30.703980+0000) 2021-08-03T12:43:30.887 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:30.881+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:30.881902+0000) 2021-08-03T12:43:30.964 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:30.960+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:30.961009+0000) 2021-08-03T12:43:31.434 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:31.428+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:31.429663+0000) 2021-08-03T12:43:31.651 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:31.647+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:31.647858+0000) 2021-08-03T12:43:31.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:31.703+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:31.704120+0000) 2021-08-03T12:43:31.965 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:31.960+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:31.961625+0000) 2021-08-03T12:43:32.143 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:32.066+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7948 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:32.425 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:43:32.229+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:43:32.698 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:43:32.692+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:32.692776+0000) 2021-08-03T12:43:32.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:32.703+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:32.704282+0000) 2021-08-03T12:43:32.842 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:32.838+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:32.839733+0000) 2021-08-03T12:43:32.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:32.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:32.959579+0000) 2021-08-03T12:43:32.966 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:32.961+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:32.962404+0000) 2021-08-03T12:43:33.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:33.653+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:33.654067+0000) 2021-08-03T12:43:33.694 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:33.690+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:33.690794+0000) 2021-08-03T12:43:33.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:33.703+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:33.704452+0000) 2021-08-03T12:43:33.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:33.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:33.959737+0000) 2021-08-03T12:43:33.966 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:33.962+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:33.963214+0000) 2021-08-03T12:43:34.342 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:43:34.337+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:34.338740+0000) 2021-08-03T12:43:34.695 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:34.690+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:34.691469+0000) 2021-08-03T12:43:34.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:34.703+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:34.704610+0000) 2021-08-03T12:43:34.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:34.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:34.959893+0000) 2021-08-03T12:43:34.967 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:34.963+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:34.963821+0000) 2021-08-03T12:43:35.020 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:35.015+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:35.016281+0000) 2021-08-03T12:43:35.252 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:35.238+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7828 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:35.348 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:35.345+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:35.345987+0000) 2021-08-03T12:43:35.483 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:35.478+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:35.479015+0000) 2021-08-03T12:43:35.695 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:35.691+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:35.692057+0000) 2021-08-03T12:43:35.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:35.703+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:35.704779+0000) 2021-08-03T12:43:35.968 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:35.963+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:35.964647+0000) 2021-08-03T12:43:36.696 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:36.691+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:36.692610+0000) 2021-08-03T12:43:36.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:36.704+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:36.704968+0000) 2021-08-03T12:43:36.968 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:36.964+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:36.965435+0000) 2021-08-03T12:43:37.438 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:43:37.433+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:37.434192+0000) 2021-08-03T12:43:37.697 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:37.692+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:37.693422+0000) 2021-08-03T12:43:37.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:37.704+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:37.705124+0000) 2021-08-03T12:43:37.970 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:37.965+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:37.966339+0000) 2021-08-03T12:43:38.464 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:38.460+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:38.461221+0000) 2021-08-03T12:43:38.697 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:38.693+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:38.693924+0000) 2021-08-03T12:43:38.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:38.704+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:38.705282+0000) 2021-08-03T12:43:38.883 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:38.878+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:38.878810+0000) 2021-08-03T12:43:38.962 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:38.901+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7952 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:38.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:38.964+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:38.965200+0000) 2021-08-03T12:43:38.970 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:38.966+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:38.967142+0000) 2021-08-03T12:43:39.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:39.436+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:39.437269+0000) 2021-08-03T12:43:39.708 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:39.704+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:39.705432+0000) 2021-08-03T12:43:39.913 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:39.907+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:39.908797+0000) 2021-08-03T12:43:39.971 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:39.966+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:39.967748+0000) 2021-08-03T12:43:40.305 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:40.300+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:40.300727+0000) 2021-08-03T12:43:40.829 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:43:40.825+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:43:41.013 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:41.009+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:41.010105+0000) 2021-08-03T12:43:41.014 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:41.009+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:41.010672+0000) 2021-08-03T12:43:41.252 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:41.248+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:41.249547+0000) 2021-08-03T12:43:41.498 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:41.473+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7851 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:42.014 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:42.010+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:42.010843+0000) 2021-08-03T12:43:42.030 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:43:42.024+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:42.025705+0000) 2021-08-03T12:43:42.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:42.444+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:42.445132+0000) 2021-08-03T12:43:42.674 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:42.669+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:42.670146+0000) 2021-08-03T12:43:43.015 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:43.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:43.011848+0000) 2021-08-03T12:43:43.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:43.444+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:43.445309+0000) 2021-08-03T12:43:44.016 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:44.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:44.012436+0000) 2021-08-03T12:43:44.380 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:44.375+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:44.376149+0000) 2021-08-03T12:43:44.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:44.444+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:44.445452+0000) 2021-08-03T12:43:45.016 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:45.012+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:45.013086+0000) 2021-08-03T12:43:45.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:45.444+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:45.445562+0000) 2021-08-03T12:43:46.017 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:46.012+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:46.013698+0000) 2021-08-03T12:43:46.442 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:46.398+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7953 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:46.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:46.444+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:46.445711+0000) 2021-08-03T12:43:46.988 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:46.984+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:46.985022+0000) 2021-08-03T12:43:47.156 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:43:47.151+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:47.152655+0000) 2021-08-03T12:43:47.488 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:47.476+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7876 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:47.529 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:47.524+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:47.524998+0000) 2021-08-03T12:43:47.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:47.759+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:47.760269+0000) 2021-08-03T12:43:47.899 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:47.895+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:47.896298+0000) 2021-08-03T12:43:48.565 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:43:48.559+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:48.560481+0000) 2021-08-03T12:43:48.587 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:48.582+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:48.583230+0000) 2021-08-03T12:43:49.025 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:49.018+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:49.019615+0000) 2021-08-03T12:43:49.059 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:49.055+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:49.056045+0000) 2021-08-03T12:43:49.767 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:49.763+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:49.764227+0000) 2021-08-03T12:43:49.868 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:49.863+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:49.864465+0000) 2021-08-03T12:43:50.247 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:50.242+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:50.243068+0000) 2021-08-03T12:43:50.467 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:50.462+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:50.463282+0000) 2021-08-03T12:43:50.868 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:50.864+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:50.865501+0000) 2021-08-03T12:43:51.101 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:51.096+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:51.097336+0000) 2021-08-03T12:43:51.248 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:51.243+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:51.244312+0000) 2021-08-03T12:43:51.869 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:51.865+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:51.866085+0000) 2021-08-03T12:43:52.204 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:52.200+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:52.201529+0000) 2021-08-03T12:43:52.248 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:52.244+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:52.245164+0000) 2021-08-03T12:43:52.870 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:52.865+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:52.866678+0000) 2021-08-03T12:43:53.239 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:43:51.085+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:43:53.249 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:53.245+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:53.246116+0000) 2021-08-03T12:43:53.870 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:53.866+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:53.867354+0000) 2021-08-03T12:43:54.250 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:54.245+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:54.246676+0000) 2021-08-03T12:43:54.481 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:54.338+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7955 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:43:54.871 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:43:54.867+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:54.867958+0000) 2021-08-03T12:43:55.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:55.354+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:55.354929+0000) 2021-08-03T12:43:55.431 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:43:55.411+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7876 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:43:56.666 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:56.662+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:56.664018+0000) 2021-08-03T12:43:57.146 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:57.142+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:57.143171+0000) 2021-08-03T12:43:57.213 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:43:57.208+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:57.209172+0000) 2021-08-03T12:43:57.283 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:43:57.279+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:57.280708+0000) 2021-08-03T12:43:57.504 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:57.499+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:57.501472+0000) 2021-08-03T12:43:57.575 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:57.570+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:57.572425+0000) 2021-08-03T12:43:57.986 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:43:57.980+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:57.982039+0000) 2021-08-03T12:43:58.011 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:43:57.869+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:43:58.147 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:43:58.143+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:58.143852+0000) 2021-08-03T12:43:58.507 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:58.502+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:58.504033+0000) 2021-08-03T12:43:58.616 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:43:58.610+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:58.611909+0000) 2021-08-03T12:43:58.712 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:43:58.706+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:58.708058+0000) 2021-08-03T12:43:58.713 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:43:58.706+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:58.708180+0000) 2021-08-03T12:43:58.806 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:43:58.800+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:58.802077+0000) 2021-08-03T12:43:59.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:43:59.504+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:43:59.506596+0000) 2021-08-03T12:43:59.893 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:43:59.825+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7968 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:00.037 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:00.032+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:00.034321+0000) 2021-08-03T12:44:00.127 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:00.122+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:00.123958+0000) 2021-08-03T12:44:01.284 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:01.155+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7882 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:01.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:01.717+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:01.719730+0000) 2021-08-03T12:44:02.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:02.566+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:02.568003+0000) 2021-08-03T12:44:02.655 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:02.649+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:02.651604+0000) 2021-08-03T12:44:03.064 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:03.058+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:03.060273+0000) 2021-08-03T12:44:03.073 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:03.069+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:03.071219+0000) 2021-08-03T12:44:03.539 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:03.533+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:03.535331+0000) 2021-08-03T12:44:03.656 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:03.650+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:03.652629+0000) 2021-08-03T12:44:03.883 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:44:03.877+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:03.879013+0000) 2021-08-03T12:44:04.656 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:04.651+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:04.653240+0000) 2021-08-03T12:44:04.690 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:04.685+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:04.687456+0000) 2021-08-03T12:44:05.156 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:05.150+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:05.152714+0000) 2021-08-03T12:44:05.638 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:05.632+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:05.634534+0000) 2021-08-03T12:44:05.657 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:05.652+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:05.653842+0000) 2021-08-03T12:44:05.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:05.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:05.960252+0000) 2021-08-03T12:44:06.306 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:06.070+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:06.658 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:06.653+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:06.654675+0000) 2021-08-03T12:44:06.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:06.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:06.960423+0000) 2021-08-03T12:44:07.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:07.445+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:07.446082+0000) 2021-08-03T12:44:07.501 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:07.263+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7978 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:07.680 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:07.674+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:07.675704+0000) 2021-08-03T12:44:07.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:07.876+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:07.877598+0000) 2021-08-03T12:44:07.888 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:07.884+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:07.885745+0000) 2021-08-03T12:44:07.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:07.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:07.960548+0000) 2021-08-03T12:44:08.208 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:08.202+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:08.203238+0000) 2021-08-03T12:44:08.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:08.445+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:08.446250+0000) 2021-08-03T12:44:08.549 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:08.498+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7885 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:08.803 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:08.797+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:08.798153+0000) 2021-08-03T12:44:08.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:08.876+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:08.877760+0000) 2021-08-03T12:44:08.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:08.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:08.960663+0000) 2021-08-03T12:44:09.276 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:09.271+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:09.272300+0000) 2021-08-03T12:44:09.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:09.445+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:09.446375+0000) 2021-08-03T12:44:09.701 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:09.696+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:09.697501+0000) 2021-08-03T12:44:09.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:09.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:09.877916+0000) 2021-08-03T12:44:09.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:09.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:09.960780+0000) 2021-08-03T12:44:10.015 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:10.011+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:10.012689+0000) 2021-08-03T12:44:10.273 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:44:10.268+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:10.269199+0000) 2021-08-03T12:44:10.276 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:10.272+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:10.273036+0000) 2021-08-03T12:44:10.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:10.445+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:10.446511+0000) 2021-08-03T12:44:10.701 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:10.697+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:10.698303+0000) 2021-08-03T12:44:10.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:10.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:10.878023+0000) 2021-08-03T12:44:10.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:10.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:10.960929+0000) 2021-08-03T12:44:11.309 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:11.304+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:11.305091+0000) 2021-08-03T12:44:11.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:11.643+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:11.644490+0000) 2021-08-03T12:44:11.702 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:11.698+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:11.698907+0000) 2021-08-03T12:44:11.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:11.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:11.878148+0000) 2021-08-03T12:44:11.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:11.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:11.961048+0000) 2021-08-03T12:44:12.411 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:12.406+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:12.407207+0000) 2021-08-03T12:44:12.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:12.584+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:12.585150+0000) 2021-08-03T12:44:12.663 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:12.658+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:12.659129+0000) 2021-08-03T12:44:12.703 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:12.698+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:12.699496+0000) 2021-08-03T12:44:12.742 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:12.615+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:12.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:12.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:12.878247+0000) 2021-08-03T12:44:12.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:12.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:12.961166+0000) 2021-08-03T12:44:13.038 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:12.953+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 7989 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:13.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:13.359+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:13.359926+0000) 2021-08-03T12:44:13.703 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:13.699+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:13.700439+0000) 2021-08-03T12:44:13.881 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:13.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:13.878382+0000) 2021-08-03T12:44:13.909 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:13.903+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:13.904291+0000) 2021-08-03T12:44:13.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:13.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:13.961287+0000) 2021-08-03T12:44:14.366 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:14.309+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7885 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:14.704 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:14.700+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:14.701008+0000) 2021-08-03T12:44:15.060 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:15.055+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:15.056000+0000) 2021-08-03T12:44:15.379 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:15.374+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:15.374781+0000) 2021-08-03T12:44:15.437 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:15.434+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:15.434996+0000) 2021-08-03T12:44:15.915 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:15.911+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:15.912474+0000) 2021-08-03T12:44:16.968 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:44:16.963+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:16.964293+0000) 2021-08-03T12:44:16.984 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:16.980+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:16.981476+0000) 2021-08-03T12:44:17.537 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:17.533+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:17.534575+0000) 2021-08-03T12:44:17.564 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:17.559+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:17.560482+0000) 2021-08-03T12:44:18.865 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:18.859+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:18.860126+0000) 2021-08-03T12:44:19.233 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:19.229+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:19.229862+0000) 2021-08-03T12:44:21.406 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:21.402+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:21.403010+0000) 2021-08-03T12:44:21.794 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:21.674+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8028 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:21.824 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:21.821+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7895 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:22.240 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:22.237+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:22.237810+0000) 2021-08-03T12:44:22.413 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:21.814+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:23.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:23.330+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:23.331674+0000) 2021-08-03T12:44:23.927 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:23.924+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:23.925169+0000) 2021-08-03T12:44:24.544 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:24.540+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:24.540990+0000) 2021-08-03T12:44:25.275 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:25.271+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:25.272351+0000) 2021-08-03T12:44:26.829 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:26.824+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:26.825447+0000) 2021-08-03T12:44:26.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:26.863+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:26.864747+0000) 2021-08-03T12:44:27.229 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:27.224+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:27.224942+0000) 2021-08-03T12:44:28.097 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:28.091+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:28.092710+0000) 2021-08-03T12:44:28.099 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:28.094+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:28.095010+0000) 2021-08-03T12:44:28.310 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:28.285+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8044 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:28.375 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:28.368+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7903 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:28.775 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:44:28.771+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:28.771794+0000) 2021-08-03T12:44:29.072 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:29.067+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:29.068085+0000) 2021-08-03T12:44:29.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:29.751+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:29.752027+0000) 2021-08-03T12:44:30.101 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:30.098+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:30.098893+0000) 2021-08-03T12:44:30.102 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:30.098+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:30.099088+0000) 2021-08-03T12:44:30.337 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:30.284+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:30.386 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:30.382+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:30.383548+0000) 2021-08-03T12:44:30.510 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:30.506+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:30.507446+0000) 2021-08-03T12:44:30.843 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:30.839+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:30.840726+0000) 2021-08-03T12:44:31.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:31.446+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:31.446922+0000) 2021-08-03T12:44:31.512 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:31.508+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:31.509752+0000) 2021-08-03T12:44:32.274 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:32.269+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:32.270245+0000) 2021-08-03T12:44:32.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:32.446+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:32.447075+0000) 2021-08-03T12:44:32.515 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:32.511+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:32.512317+0000) 2021-08-03T12:44:32.537 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:32.533+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:32.533850+0000) 2021-08-03T12:44:32.693 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:32.689+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:32.690687+0000) 2021-08-03T12:44:32.704 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:32.699+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:32.700676+0000) 2021-08-03T12:44:32.796 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:32.791+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:32.791886+0000) 2021-08-03T12:44:33.450 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:33.446+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:33.447209+0000) 2021-08-03T12:44:33.515 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:33.512+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:33.512938+0000) 2021-08-03T12:44:33.538 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:33.533+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:33.534639+0000) 2021-08-03T12:44:33.704 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:33.700+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:33.701344+0000) 2021-08-03T12:44:34.450 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:34.446+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:34.447350+0000) 2021-08-03T12:44:34.515 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:34.512+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:34.513118+0000) 2021-08-03T12:44:34.539 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:34.534+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:34.535447+0000) 2021-08-03T12:44:34.705 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:34.701+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:34.701890+0000) 2021-08-03T12:44:35.159 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:35.135+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7910 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:35.305 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:35.300+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:35.301314+0000) 2021-08-03T12:44:35.388 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:35.348+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8072 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:35.515 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:35.512+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:35.513247+0000) 2021-08-03T12:44:35.540 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:35.535+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:35.536268+0000) 2021-08-03T12:44:35.705 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:35.701+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:35.702622+0000) 2021-08-03T12:44:36.075 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:36.071+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:36.072569+0000) 2021-08-03T12:44:36.088 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:36.083+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:36.083882+0000) 2021-08-03T12:44:36.706 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:36.702+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:36.702994+0000) 2021-08-03T12:44:36.834 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:36.829+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:36.830119+0000) 2021-08-03T12:44:37.525 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:37.519+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:37.519882+0000) 2021-08-03T12:44:37.636 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:37.162+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3497 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:37.664 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:37.660+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:37.660940+0000) 2021-08-03T12:44:37.707 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:37.702+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:37.703539+0000) 2021-08-03T12:44:38.104 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:38.100+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:38.101187+0000) 2021-08-03T12:44:38.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:38.615+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:38.616222+0000) 2021-08-03T12:44:38.665 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:38.660+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:38.661543+0000) 2021-08-03T12:44:38.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:38.673+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:38.674439+0000) 2021-08-03T12:44:38.710 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:38.705+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:38.706589+0000) 2021-08-03T12:44:38.865 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:38.861+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:38.862311+0000) 2021-08-03T12:44:39.105 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:39.101+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:39.101908+0000) 2021-08-03T12:44:39.665 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:39.661+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:39.662151+0000) 2021-08-03T12:44:39.711 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:39.707+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:39.708006+0000) 2021-08-03T12:44:39.751 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:39.745+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:39.746038+0000) 2021-08-03T12:44:39.769 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:39.765+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:39.766592+0000) 2021-08-03T12:44:40.007 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:44:40.001+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:40.002193+0000) 2021-08-03T12:44:40.032 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:40.027+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:40.028014+0000) 2021-08-03T12:44:40.106 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:40.101+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:40.102594+0000) 2021-08-03T12:44:40.666 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:40.662+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:40.662736+0000) 2021-08-03T12:44:40.712 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:40.707+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:40.708559+0000) 2021-08-03T12:44:40.871 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:40.865+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:40.866489+0000) 2021-08-03T12:44:41.107 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:41.102+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:41.103414+0000) 2021-08-03T12:44:41.667 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:41.662+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:41.663355+0000) 2021-08-03T12:44:41.712 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:41.708+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:41.709095+0000) 2021-08-03T12:44:41.899 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:41.830+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8072 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:42.107 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:42.103+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:42.104143+0000) 2021-08-03T12:44:42.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:42.583+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:42.584651+0000) 2021-08-03T12:44:42.667 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:42.663+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:42.663976+0000) 2021-08-03T12:44:42.712 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:42.614+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7929 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:42.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:42.712+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:42.713205+0000) 2021-08-03T12:44:42.876 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:44:42.871+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:42.872046+0000) 2021-08-03T12:44:43.117 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:43.112+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:43.113261+0000) 2021-08-03T12:44:44.165 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:44.145+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3498 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:44.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:44.197+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:44.198375+0000) 2021-08-03T12:44:44.242 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:44.236+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:44.237424+0000) 2021-08-03T12:44:44.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:44.285+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:44.286006+0000) 2021-08-03T12:44:44.532 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:44.526+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:44.527746+0000) 2021-08-03T12:44:44.881 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:44.878+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:44.878819+0000) 2021-08-03T12:44:44.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:44.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:44.961704+0000) 2021-08-03T12:44:45.011 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:45.005+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:45.006243+0000) 2021-08-03T12:44:45.881 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:45.878+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:45.878967+0000) 2021-08-03T12:44:45.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:45.961+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:45.961837+0000) 2021-08-03T12:44:46.126 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:46.121+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:46.122105+0000) 2021-08-03T12:44:46.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:46.406+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:46.407762+0000) 2021-08-03T12:44:46.645 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:46.640+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:46.641600+0000) 2021-08-03T12:44:46.672 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:46.668+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:46.669343+0000) 2021-08-03T12:44:46.881 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:46.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:46.879103+0000) 2021-08-03T12:44:46.921 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:46.915+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:46.917351+0000) 2021-08-03T12:44:46.934 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:46.911+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8075 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:46.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:46.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:46.961948+0000) 2021-08-03T12:44:47.113 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:47.107+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:47.109034+0000) 2021-08-03T12:44:47.545 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:47.541+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:47.542599+0000) 2021-08-03T12:44:47.674 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:47.669+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:47.670639+0000) 2021-08-03T12:44:47.799 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:47.699+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7947 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:47.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:47.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:47.879215+0000) 2021-08-03T12:44:47.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:47.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:47.962073+0000) 2021-08-03T12:44:48.675 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:48.670+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:48.671442+0000) 2021-08-03T12:44:48.854 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:48.847+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:48.849332+0000) 2021-08-03T12:44:48.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:48.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:48.879350+0000) 2021-08-03T12:44:48.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:48.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:48.962261+0000) 2021-08-03T12:44:49.675 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:49.671+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:49.672626+0000) 2021-08-03T12:44:49.817 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:49.811+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:49.812310+0000) 2021-08-03T12:44:49.848 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:49.843+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:49.845167+0000) 2021-08-03T12:44:49.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:49.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:49.879472+0000) 2021-08-03T12:44:49.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:49.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:49.962389+0000) 2021-08-03T12:44:50.075 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:50.070+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:50.071027+0000) 2021-08-03T12:44:50.677 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:50.672+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:50.673595+0000) 2021-08-03T12:44:50.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:50.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:50.879589+0000) 2021-08-03T12:44:50.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:50.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:50.962501+0000) 2021-08-03T12:44:51.183 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:51.177+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:51.178765+0000) 2021-08-03T12:44:51.678 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:51.673+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:51.674209+0000) 2021-08-03T12:44:51.710 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:51.704+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:51.705846+0000) 2021-08-03T12:44:51.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:51.877+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:51.879721+0000) 2021-08-03T12:44:51.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:51.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:51.962656+0000) 2021-08-03T12:44:52.102 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:52.032+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8084 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:52.146 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:52.139+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:52.141060+0000) 2021-08-03T12:44:52.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:52.636+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:52.637856+0000) 2021-08-03T12:44:52.644 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:52.637+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3498 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:52.678 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:52.674+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:52.675012+0000) 2021-08-03T12:44:52.697 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:52.691+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:52.693180+0000) 2021-08-03T12:44:52.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:52.878+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:52.879861+0000) 2021-08-03T12:44:52.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:52.960+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:52.962782+0000) 2021-08-03T12:44:53.337 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:53.332+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:53.333474+0000) 2021-08-03T12:44:53.679 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:53.674+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:53.675581+0000) 2021-08-03T12:44:53.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:53.878+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:53.880019+0000) 2021-08-03T12:44:53.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:53.961+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:53.962902+0000) 2021-08-03T12:44:54.232 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:44:53.953+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7961 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:44:54.618 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:54.614+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:54.615039+0000) 2021-08-03T12:44:54.630 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:44:54.625+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:54.626407+0000) 2021-08-03T12:44:54.679 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:54.675+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:54.676242+0000) 2021-08-03T12:44:54.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:54.878+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:54.880130+0000) 2021-08-03T12:44:54.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:54.961+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:54.963031+0000) 2021-08-03T12:44:55.148 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:44:55.145+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:55.145901+0000) 2021-08-03T12:44:55.260 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:55.256+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:55.257133+0000) 2021-08-03T12:44:55.414 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:44:55.408+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:55.409941+0000) 2021-08-03T12:44:55.619 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:55.614+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:55.615738+0000) 2021-08-03T12:44:55.680 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:55.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:55.676806+0000) 2021-08-03T12:44:55.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:55.879+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:55.880266+0000) 2021-08-03T12:44:55.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:55.962+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:55.963143+0000) 2021-08-03T12:44:56.261 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:56.257+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:56.257843+0000) 2021-08-03T12:44:56.620 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:44:56.615+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:56.616380+0000) 2021-08-03T12:44:56.622 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:56.618+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:56.619319+0000) 2021-08-03T12:44:56.681 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:56.676+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:56.677628+0000) 2021-08-03T12:44:56.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:56.879+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:56.880364+0000) 2021-08-03T12:44:56.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:56.962+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:56.963240+0000) 2021-08-03T12:44:57.041 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:44:57.037+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:57.037862+0000) 2021-08-03T12:44:57.262 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:57.257+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:57.258448+0000) 2021-08-03T12:44:57.481 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:44:57.178+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8087 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:44:57.682 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:44:57.677+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:57.678328+0000) 2021-08-03T12:44:57.690 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:44:57.686+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:57.686988+0000) 2021-08-03T12:44:57.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:57.879+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:57.880466+0000) 2021-08-03T12:44:57.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:57.962+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:57.963362+0000) 2021-08-03T12:44:58.266 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:58.261+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:58.262135+0000) 2021-08-03T12:44:58.788 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:44:58.783+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:58.783977+0000) 2021-08-03T12:44:58.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:58.879+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:58.880598+0000) 2021-08-03T12:44:58.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:58.962+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:58.963480+0000) 2021-08-03T12:44:59.267 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:44:59.262+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:59.263403+0000) 2021-08-03T12:44:59.575 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:44:59.569+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3498 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:44:59.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:59.879+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:59.880752+0000) 2021-08-03T12:44:59.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:44:59.962+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:44:59.963591+0000) 2021-08-03T12:45:00.268 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:00.263+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:00.264628+0000) 2021-08-03T12:45:00.709 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:00.705+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:00.706467+0000) 2021-08-03T12:45:00.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:00.880+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:00.880860+0000) 2021-08-03T12:45:00.957 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:00.905+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7969 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:00.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:00.962+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:00.963724+0000) 2021-08-03T12:45:01.268 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:01.264+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:01.265211+0000) 2021-08-03T12:45:01.709 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:01.705+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:01.706625+0000) 2021-08-03T12:45:01.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:01.880+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:01.880997+0000) 2021-08-03T12:45:01.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:01.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:01.963838+0000) 2021-08-03T12:45:02.269 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:02.264+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:02.265754+0000) 2021-08-03T12:45:02.709 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:02.705+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:02.706764+0000) 2021-08-03T12:45:02.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:02.880+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:02.881139+0000) 2021-08-03T12:45:02.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:02.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:02.963961+0000) 2021-08-03T12:45:03.114 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:03.110+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:03.110515+0000) 2021-08-03T12:45:03.270 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:03.266+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:03.267360+0000) 2021-08-03T12:45:03.709 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:03.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:03.706900+0000) 2021-08-03T12:45:03.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:03.880+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:03.881295+0000) 2021-08-03T12:45:03.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:03.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:03.964080+0000) 2021-08-03T12:45:04.116 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:04.111+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:04.112191+0000) 2021-08-03T12:45:04.271 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:04.267+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:04.268289+0000) 2021-08-03T12:45:04.709 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:04.704+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:04.704988+0000) 2021-08-03T12:45:04.709 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:04.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:04.707019+0000) 2021-08-03T12:45:04.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:04.880+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:04.881448+0000) 2021-08-03T12:45:04.919 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:04.685+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8118 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:04.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:04.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:04.964219+0000) 2021-08-03T12:45:05.272 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:05.268+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:05.269109+0000) 2021-08-03T12:45:05.435 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:05.431+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:05.432040+0000) 2021-08-03T12:45:05.709 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:05.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:05.707150+0000) 2021-08-03T12:45:05.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:05.880+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:05.881571+0000) 2021-08-03T12:45:05.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:05.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:05.964325+0000) 2021-08-03T12:45:06.273 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:06.269+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:06.269995+0000) 2021-08-03T12:45:06.437 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:06.431+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:06.432584+0000) 2021-08-03T12:45:06.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:06.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:06.707281+0000) 2021-08-03T12:45:06.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:06.880+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:06.881688+0000) 2021-08-03T12:45:06.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:06.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:06.964425+0000) 2021-08-03T12:45:07.273 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:07.269+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:07.270578+0000) 2021-08-03T12:45:07.436 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:07.432+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:07.433148+0000) 2021-08-03T12:45:07.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:07.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:07.707404+0000) 2021-08-03T12:45:07.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:07.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:07.881844+0000) 2021-08-03T12:45:07.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:07.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:07.964544+0000) 2021-08-03T12:45:08.139 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:08.073+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7981 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:08.275 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:08.271+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:08.271822+0000) 2021-08-03T12:45:08.437 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:08.433+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:08.433824+0000) 2021-08-03T12:45:08.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:08.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:08.707511+0000) 2021-08-03T12:45:08.714 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:45:08.708+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:08.709412+0000) 2021-08-03T12:45:08.811 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:08.808+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:08.808950+0000) 2021-08-03T12:45:08.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:08.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:08.881969+0000) 2021-08-03T12:45:08.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:08.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:08.964673+0000) 2021-08-03T12:45:09.275 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:09.271+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:09.272356+0000) 2021-08-03T12:45:09.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:09.332+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:09.333041+0000) 2021-08-03T12:45:09.340 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:09.334+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:09.335742+0000) 2021-08-03T12:45:09.368 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:45:09.333+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3498 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:45:09.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:09.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:09.707633+0000) 2021-08-03T12:45:09.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:09.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:09.882130+0000) 2021-08-03T12:45:09.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:09.963+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:09.964781+0000) 2021-08-03T12:45:10.276 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:10.272+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:10.272963+0000) 2021-08-03T12:45:10.520 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:10.515+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:10.516059+0000) 2021-08-03T12:45:10.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:10.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:10.707751+0000) 2021-08-03T12:45:10.728 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:10.724+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8120 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:10.751 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:10.746+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:10.747528+0000) 2021-08-03T12:45:10.777 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:10.772+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:10.773349+0000) 2021-08-03T12:45:10.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:10.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:10.882264+0000) 2021-08-03T12:45:10.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:10.964+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:10.964855+0000) 2021-08-03T12:45:11.277 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:11.271+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:11.273774+0000) 2021-08-03T12:45:11.368 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:45:11.363+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:11.364363+0000) 2021-08-03T12:45:11.706 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:11.700+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:11.702753+0000) 2021-08-03T12:45:11.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:11.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:11.707914+0000) 2021-08-03T12:45:11.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:11.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:11.882393+0000) 2021-08-03T12:45:11.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:11.964+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:11.964948+0000) 2021-08-03T12:45:12.278 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:12.273+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:12.274855+0000) 2021-08-03T12:45:12.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:12.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:12.708055+0000) 2021-08-03T12:45:12.717 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:12.713+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:12.714577+0000) 2021-08-03T12:45:12.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:12.853+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:12.854551+0000) 2021-08-03T12:45:12.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:12.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:12.882514+0000) 2021-08-03T12:45:12.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:12.964+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:12.965062+0000) 2021-08-03T12:45:13.279 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:13.273+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:13.275699+0000) 2021-08-03T12:45:13.672 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:45:13.668+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:13.668958+0000) 2021-08-03T12:45:13.710 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:13.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:13.708196+0000) 2021-08-03T12:45:13.719 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:13.714+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:13.715401+0000) 2021-08-03T12:45:13.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:13.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:13.882668+0000) 2021-08-03T12:45:13.968 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:13.964+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:13.965202+0000) 2021-08-03T12:45:14.280 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:14.274+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:14.276277+0000) 2021-08-03T12:45:14.673 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:45:14.668+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:14.669685+0000) 2021-08-03T12:45:14.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:14.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:14.708329+0000) 2021-08-03T12:45:14.720 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:14.715+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:14.716599+0000) 2021-08-03T12:45:14.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:14.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:14.882826+0000) 2021-08-03T12:45:14.968 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:14.964+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:14.965351+0000) 2021-08-03T12:45:15.283 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:15.275+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:15.277157+0000) 2021-08-03T12:45:15.502 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:15.294+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 7989 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:15.674 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:45:15.414+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3498 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:45:15.674 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:45:15.669+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:15.670472+0000) 2021-08-03T12:45:15.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:15.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:15.708465+0000) 2021-08-03T12:45:15.711 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:45:15.706+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:15.707425+0000) 2021-08-03T12:45:15.720 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:15.716+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:15.717130+0000) 2021-08-03T12:45:15.920 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:15.917+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:15.918133+0000) 2021-08-03T12:45:16.035 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:16.032+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:16.032942+0000) 2021-08-03T12:45:16.191 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:16.186+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:16.188041+0000) 2021-08-03T12:45:16.281 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:16.276+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:16.278001+0000) 2021-08-03T12:45:16.675 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:45:16.670+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:16.671308+0000) 2021-08-03T12:45:16.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:16.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:16.708607+0000) 2021-08-03T12:45:16.712 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:45:16.707+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:16.708116+0000) 2021-08-03T12:45:16.721 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:16.717+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:16.717852+0000) 2021-08-03T12:45:17.192 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:17.186+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:17.188641+0000) 2021-08-03T12:45:17.282 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:17.276+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:17.278583+0000) 2021-08-03T12:45:17.531 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:17.525+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8133 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:17.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:17.706+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:17.708746+0000) 2021-08-03T12:45:18.195 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:18.189+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:18.191078+0000) 2021-08-03T12:45:18.282 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:18.277+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:18.279180+0000) 2021-08-03T12:45:18.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:18.469+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:18.470557+0000) 2021-08-03T12:45:18.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:18.707+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:18.708874+0000) 2021-08-03T12:45:19.283 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:19.279+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:19.279996+0000) 2021-08-03T12:45:19.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:19.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:19.709016+0000) 2021-08-03T12:45:20.284 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:20.279+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:20.280598+0000) 2021-08-03T12:45:20.567 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:20.564+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:20.564868+0000) 2021-08-03T12:45:20.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:20.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:20.709157+0000) 2021-08-03T12:45:21.159 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:45:21.153+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:21.154144+0000) 2021-08-03T12:45:21.203 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:45:21.198+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:21.199032+0000) 2021-08-03T12:45:21.285 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:21.280+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:21.281648+0000) 2021-08-03T12:45:21.671 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:21.666+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:21.666845+0000) 2021-08-03T12:45:21.711 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:21.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:21.709304+0000) 2021-08-03T12:45:21.737 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:21.732+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:21.733036+0000) 2021-08-03T12:45:22.286 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:22.281+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:22.282500+0000) 2021-08-03T12:45:22.329 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:22.321+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:22.322774+0000) 2021-08-03T12:45:22.520 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:22.515+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:22.516529+0000) 2021-08-03T12:45:22.712 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:22.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:22.709445+0000) 2021-08-03T12:45:22.866 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:45:22.848+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3500 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:45:23.287 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:23.282+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:23.283499+0000) 2021-08-03T12:45:23.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:23.671+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:23.672086+0000) 2021-08-03T12:45:23.712 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:23.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:23.709578+0000) 2021-08-03T12:45:23.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:23.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:23.771992+0000) 2021-08-03T12:45:23.964 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:23.724+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8006 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:24.287 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:24.283+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:24.284024+0000) 2021-08-03T12:45:24.324 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:24.321+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:24.322068+0000) 2021-08-03T12:45:24.712 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:24.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:24.709728+0000) 2021-08-03T12:45:24.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:24.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:24.772151+0000) 2021-08-03T12:45:25.121 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:25.116+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:25.117348+0000) 2021-08-03T12:45:25.183 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:24.978+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8168 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:25.288 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:25.283+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:25.284618+0000) 2021-08-03T12:45:25.712 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:25.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:25.709916+0000) 2021-08-03T12:45:25.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:25.775+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:25.776422+0000) 2021-08-03T12:45:25.782 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:25.776+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:25.777594+0000) 2021-08-03T12:45:26.121 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:26.117+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:26.118059+0000) 2021-08-03T12:45:26.712 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:26.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:26.710055+0000) 2021-08-03T12:45:27.121 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:27.117+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:27.118606+0000) 2021-08-03T12:45:27.624 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:27.620+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:27.620801+0000) 2021-08-03T12:45:27.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:27.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:27.710205+0000) 2021-08-03T12:45:27.733 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:27.728+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:27.729189+0000) 2021-08-03T12:45:27.971 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:27.968+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:27.968965+0000) 2021-08-03T12:45:28.044 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:28.040+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:28.041241+0000) 2021-08-03T12:45:28.122 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:28.118+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:28.119555+0000) 2021-08-03T12:45:28.132 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:28.126+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:28.127393+0000) 2021-08-03T12:45:28.321 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:28.317+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:28.318168+0000) 2021-08-03T12:45:28.625 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:28.620+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:28.621527+0000) 2021-08-03T12:45:28.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:28.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:28.710342+0000) 2021-08-03T12:45:29.045 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:29.041+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:29.042179+0000) 2021-08-03T12:45:29.123 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:29.119+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:29.120166+0000) 2021-08-03T12:45:29.291 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:29.288+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:29.288964+0000) 2021-08-03T12:45:29.322 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:29.318+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:29.318921+0000) 2021-08-03T12:45:29.626 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:29.621+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:29.622517+0000) 2021-08-03T12:45:29.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:29.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:29.710489+0000) 2021-08-03T12:45:30.014 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:29.653+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:30.046 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:30.042+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:30.042748+0000) 2021-08-03T12:45:30.124 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:30.120+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:30.120938+0000) 2021-08-03T12:45:30.323 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:30.318+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:30.319706+0000) 2021-08-03T12:45:30.383 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:30.249+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8175 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:30.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:30.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:30.710640+0000) 2021-08-03T12:45:31.036 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:31.032+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:31.033372+0000) 2021-08-03T12:45:31.047 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:31.042+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:31.043324+0000) 2021-08-03T12:45:31.057 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:31.053+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:31.054534+0000) 2021-08-03T12:45:31.125 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:31.121+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:31.121799+0000) 2021-08-03T12:45:31.323 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:31.319+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:31.320313+0000) 2021-08-03T12:45:32.048 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:32.043+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:32.044112+0000) 2021-08-03T12:45:32.324 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:32.320+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:32.320901+0000) 2021-08-03T12:45:32.385 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:45:32.085+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3504 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:45:33.048 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:33.043+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:33.044654+0000) 2021-08-03T12:45:33.325 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:33.320+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:33.321464+0000) 2021-08-03T12:45:34.049 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:34.045+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:34.045871+0000) 2021-08-03T12:45:34.181 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:34.177+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:34.178164+0000) 2021-08-03T12:45:34.325 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:34.321+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:34.322374+0000) 2021-08-03T12:45:34.633 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:34.628+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:34.629153+0000) 2021-08-03T12:45:35.050 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:35.045+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:35.046434+0000) 2021-08-03T12:45:35.183 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:35.178+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:35.179142+0000) 2021-08-03T12:45:35.327 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:35.322+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:35.323401+0000) 2021-08-03T12:45:36.051 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:36.045+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:36.047384+0000) 2021-08-03T12:45:36.184 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:36.179+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:36.180609+0000) 2021-08-03T12:45:36.327 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:36.323+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:36.324482+0000) 2021-08-03T12:45:36.517 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:36.512+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:36.514554+0000) 2021-08-03T12:45:37.051 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:37.046+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:37.047951+0000) 2021-08-03T12:45:37.185 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:37.181+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:37.182205+0000) 2021-08-03T12:45:37.190 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:37.186+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:37.188107+0000) 2021-08-03T12:45:37.328 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:37.324+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:37.325042+0000) 2021-08-03T12:45:37.520 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:37.515+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:37.517124+0000) 2021-08-03T12:45:38.052 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:38.046+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:38.048525+0000) 2021-08-03T12:45:38.153 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:37.975+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8176 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:38.186 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:38.182+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:38.183295+0000) 2021-08-03T12:45:38.191 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:38.186+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:38.188243+0000) 2021-08-03T12:45:38.329 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:38.324+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:38.325618+0000) 2021-08-03T12:45:38.399 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:37.980+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:38.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:38.517+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:38.519684+0000) 2021-08-03T12:45:39.053 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:39.047+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:39.049215+0000) 2021-08-03T12:45:39.108 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:39.104+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:39.105914+0000) 2021-08-03T12:45:39.188 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:39.183+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:39.184501+0000) 2021-08-03T12:45:39.191 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:39.186+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:39.188379+0000) 2021-08-03T12:45:39.331 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:39.326+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:39.327520+0000) 2021-08-03T12:45:39.478 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:45:39.472+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:39.474054+0000) 2021-08-03T12:45:39.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:39.518+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:39.520762+0000) 2021-08-03T12:45:40.053 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:40.048+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:40.049777+0000) 2021-08-03T12:45:40.108 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:40.104+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:40.106043+0000) 2021-08-03T12:45:40.163 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:40.158+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:40.159495+0000) 2021-08-03T12:45:40.189 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:40.184+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:40.185438+0000) 2021-08-03T12:45:40.191 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:40.186+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:40.188498+0000) 2021-08-03T12:45:40.332 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:40.327+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:40.328280+0000) 2021-08-03T12:45:40.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:40.519+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:40.520968+0000) 2021-08-03T12:45:41.109 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:41.104+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:41.106179+0000) 2021-08-03T12:45:41.190 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:41.185+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:41.186437+0000) 2021-08-03T12:45:41.191 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:41.186+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:41.188661+0000) 2021-08-03T12:45:41.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:41.519+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:41.521126+0000) 2021-08-03T12:45:42.109 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:42.104+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:42.106328+0000) 2021-08-03T12:45:42.173 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:45:41.778+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3507 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:45:42.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:42.186+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:42.188781+0000) 2021-08-03T12:45:42.192 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:42.186+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:42.187602+0000) 2021-08-03T12:45:42.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:42.519+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:42.521342+0000) 2021-08-03T12:45:43.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:43.187+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:43.188949+0000) 2021-08-03T12:45:43.192 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:43.188+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:43.188870+0000) 2021-08-03T12:45:43.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:43.519+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:43.521488+0000) 2021-08-03T12:45:44.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:44.187+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:44.189080+0000) 2021-08-03T12:45:44.193 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:44.189+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:44.189843+0000) 2021-08-03T12:45:44.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:44.519+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:44.521714+0000) 2021-08-03T12:45:44.889 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:44.881+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8206 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:44.942 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:44.203+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:45.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:45.188+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:45.189216+0000) 2021-08-03T12:45:45.194 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:45.189+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:45.190795+0000) 2021-08-03T12:45:45.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:45.521+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:45.521837+0000) 2021-08-03T12:45:46.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:46.188+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:46.189384+0000) 2021-08-03T12:45:46.195 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:46.190+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:46.191780+0000) 2021-08-03T12:45:46.515 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:46.509+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:46.510596+0000) 2021-08-03T12:45:46.811 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:46.806+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:46.807110+0000) 2021-08-03T12:45:47.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:47.188+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:47.189529+0000) 2021-08-03T12:45:47.727 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:47.723+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:47.724002+0000) 2021-08-03T12:45:48.189 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:48.185+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:48.186485+0000) 2021-08-03T12:45:48.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:48.188+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:48.189657+0000) 2021-08-03T12:45:48.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:48.190+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:48.190837+0000) 2021-08-03T12:45:48.728 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:48.723+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:48.724677+0000) 2021-08-03T12:45:49.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:49.188+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:49.189772+0000) 2021-08-03T12:45:49.728 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:49.724+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:49.725231+0000) 2021-08-03T12:45:49.799 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:45:49.793+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3509 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:45:50.191 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:50.185+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:50.186215+0000) 2021-08-03T12:45:50.192 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:50.189+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:50.189910+0000) 2021-08-03T12:45:50.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:50.764+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:50.765452+0000) 2021-08-03T12:45:50.936 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:50.929+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:50.930539+0000) 2021-08-03T12:45:51.096 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:51.091+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8207 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:51.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:51.189+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:51.190081+0000) 2021-08-03T12:45:51.230 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:51.219+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:51.930 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:51.924+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:51.925605+0000) 2021-08-03T12:45:51.933 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:45:51.929+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:51.929817+0000) 2021-08-03T12:45:52.128 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:52.124+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:52.125695+0000) 2021-08-03T12:45:52.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:52.189+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:52.190185+0000) 2021-08-03T12:45:52.220 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:45:52.214+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:52.215433+0000) 2021-08-03T12:45:52.512 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:45:52.506+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:52.507362+0000) 2021-08-03T12:45:53.129 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:53.125+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:53.126194+0000) 2021-08-03T12:45:53.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:53.189+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:53.190321+0000) 2021-08-03T12:45:53.951 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:53.947+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:53.948201+0000) 2021-08-03T12:45:54.130 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:54.125+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:54.126717+0000) 2021-08-03T12:45:54.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:54.189+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:54.190447+0000) 2021-08-03T12:45:54.199 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:45:54.194+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:54.194760+0000) 2021-08-03T12:45:54.952 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:54.948+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:54.949011+0000) 2021-08-03T12:45:55.130 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:55.126+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:55.127256+0000) 2021-08-03T12:45:55.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:55.189+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:55.190566+0000) 2021-08-03T12:45:55.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:55.447+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:55.448288+0000) 2021-08-03T12:45:55.953 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:55.949+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:55.949826+0000) 2021-08-03T12:45:56.131 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:56.126+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:56.127802+0000) 2021-08-03T12:45:56.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:56.189+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:56.190711+0000) 2021-08-03T12:45:56.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:56.439+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:56.440038+0000) 2021-08-03T12:45:56.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:56.447+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:56.448425+0000) 2021-08-03T12:45:56.684 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:45:56.681+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:56.681899+0000) 2021-08-03T12:45:56.954 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:56.949+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:56.950606+0000) 2021-08-03T12:45:57.131 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:57.127+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:57.128364+0000) 2021-08-03T12:45:57.193 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:57.190+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:57.190874+0000) 2021-08-03T12:45:57.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:57.439+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:57.440151+0000) 2021-08-03T12:45:57.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:57.447+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:57.448542+0000) 2021-08-03T12:45:57.663 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:45:57.658+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8217 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:45:57.956 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:57.951+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:57.952551+0000) 2021-08-03T12:45:58.132 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:58.128+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:58.128904+0000) 2021-08-03T12:45:58.217 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:58.212+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:58.213421+0000) 2021-08-03T12:45:58.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:58.439+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:58.440262+0000) 2021-08-03T12:45:58.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:58.447+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:58.448671+0000) 2021-08-03T12:45:58.498 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:45:58.308+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:45:58.956 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:58.952+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:58.953135+0000) 2021-08-03T12:45:59.133 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:45:59.128+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:59.129450+0000) 2021-08-03T12:45:59.218 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:45:59.213+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:59.214660+0000) 2021-08-03T12:45:59.284 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:59.280+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:59.281681+0000) 2021-08-03T12:45:59.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:59.439+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:59.440386+0000) 2021-08-03T12:45:59.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:45:59.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:59.448800+0000) 2021-08-03T12:45:59.957 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:45:59.952+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:45:59.953743+0000) 2021-08-03T12:46:00.133 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:00.129+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:00.129990+0000) 2021-08-03T12:46:00.218 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:00.214+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:00.215659+0000) 2021-08-03T12:46:00.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:00.439+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:00.440537+0000) 2021-08-03T12:46:00.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:00.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:00.448909+0000) 2021-08-03T12:46:00.630 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:00.626+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:00.627292+0000) 2021-08-03T12:46:00.958 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:00.953+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:00.954639+0000) 2021-08-03T12:46:01.057 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:01.052+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:01.053217+0000) 2021-08-03T12:46:01.134 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:01.129+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:01.130544+0000) 2021-08-03T12:46:01.219 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:01.215+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:01.216220+0000) 2021-08-03T12:46:01.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:01.439+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:01.440657+0000) 2021-08-03T12:46:01.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:01.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:01.449030+0000) 2021-08-03T12:46:01.631 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:01.627+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:01.627998+0000) 2021-08-03T12:46:01.958 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:01.954+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:01.955270+0000) 2021-08-03T12:46:02.057 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:02.053+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.053929+0000) 2021-08-03T12:46:02.134 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:02.130+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.131129+0000) 2021-08-03T12:46:02.220 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:02.216+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.217041+0000) 2021-08-03T12:46:02.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:02.440+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.440804+0000) 2021-08-03T12:46:02.451 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:02.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.449137+0000) 2021-08-03T12:46:02.592 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:02.586+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.587597+0000) 2021-08-03T12:46:02.632 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:02.628+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.628785+0000) 2021-08-03T12:46:02.959 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:02.955+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:02.955867+0000) 2021-08-03T12:46:03.058 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:03.053+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.054467+0000) 2021-08-03T12:46:03.119 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:03.116+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.117107+0000) 2021-08-03T12:46:03.135 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:03.131+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.131806+0000) 2021-08-03T12:46:03.221 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:03.216+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.217609+0000) 2021-08-03T12:46:03.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:03.440+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.440964+0000) 2021-08-03T12:46:03.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:03.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.449254+0000) 2021-08-03T12:46:03.633 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:03.628+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.629613+0000) 2021-08-03T12:46:03.913 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:03.601+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:03.960 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:03.955+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:03.956491+0000) 2021-08-03T12:46:04.058 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:04.054+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.055168+0000) 2021-08-03T12:46:04.120 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:04.116+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.117257+0000) 2021-08-03T12:46:04.139 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:04.131+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.132589+0000) 2021-08-03T12:46:04.221 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:04.217+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.218392+0000) 2021-08-03T12:46:04.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:04.440+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.441105+0000) 2021-08-03T12:46:04.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:04.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.449369+0000) 2021-08-03T12:46:04.633 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:04.629+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.630386+0000) 2021-08-03T12:46:04.961 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:04.956+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:04.957714+0000) 2021-08-03T12:46:05.059 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:05.055+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.055737+0000) 2021-08-03T12:46:05.120 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:05.116+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.117405+0000) 2021-08-03T12:46:05.136 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:05.132+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.133432+0000) 2021-08-03T12:46:05.222 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:05.218+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.218955+0000) 2021-08-03T12:46:05.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:05.440+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.441221+0000) 2021-08-03T12:46:05.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:05.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.449485+0000) 2021-08-03T12:46:05.571 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:46:05.486+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8228 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:46:05.634 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:05.630+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.630982+0000) 2021-08-03T12:46:05.962 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:05.957+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:05.958697+0000) 2021-08-03T12:46:06.059 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:06.055+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:06.056310+0000) 2021-08-03T12:46:06.120 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:06.116+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:06.117553+0000) 2021-08-03T12:46:06.137 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:06.133+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:06.133989+0000) 2021-08-03T12:46:06.223 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:06.219+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:06.219969+0000) 2021-08-03T12:46:06.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:06.440+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:06.441345+0000) 2021-08-03T12:46:06.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:06.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:06.449626+0000) 2021-08-03T12:46:06.635 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:06.631+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:06.631770+0000) 2021-08-03T12:46:06.682 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:06.348+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3534 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:07.060 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:07.056+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:07.057081+0000) 2021-08-03T12:46:07.391 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:07.386+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:07.386886+0000) 2021-08-03T12:46:07.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:07.440+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:07.441516+0000) 2021-08-03T12:46:07.636 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:07.631+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:07.632663+0000) 2021-08-03T12:46:09.307 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:09.302+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:09.302835+0000) 2021-08-03T12:46:09.704 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:09.699+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:09.700173+0000) 2021-08-03T12:46:09.950 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:09.870+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:11.435 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:11.431+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:11.432109+0000) 2021-08-03T12:46:11.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:11.440+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:11.441140+0000) 2021-08-03T12:46:11.570 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:11.565+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:11.566107+0000) 2021-08-03T12:46:12.038 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:11.549+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3534 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:12.049 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:12.046+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:12.047048+0000) 2021-08-03T12:46:13.677 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:46:13.671+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:13.672662+0000) 2021-08-03T12:46:13.717 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:13.713+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:13.714204+0000) 2021-08-03T12:46:13.934 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:13.928+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:13.929733+0000) 2021-08-03T12:46:14.305 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:46:14.193+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8228 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:46:14.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:14.353+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:14.354586+0000) 2021-08-03T12:46:14.401 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:46:14.395+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:14.396581+0000) 2021-08-03T12:46:14.843 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:14.838+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:14.839299+0000) 2021-08-03T12:46:15.215 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:46:15.209+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:15.210212+0000) 2021-08-03T12:46:15.250 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:15.245+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:15.245810+0000) 2021-08-03T12:46:15.824 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:46:15.820+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:15.821415+0000) 2021-08-03T12:46:16.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:16.006+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:16.006887+0000) 2021-08-03T12:46:16.525 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:16.521+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:16.522234+0000) 2021-08-03T12:46:17.009 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:17.006+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:17.007045+0000) 2021-08-03T12:46:17.156 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:17.151+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:17.152743+0000) 2021-08-03T12:46:17.333 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:17.329+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:17.330766+0000) 2021-08-03T12:46:17.352 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:17.347+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:17.348356+0000) 2021-08-03T12:46:17.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:17.525+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:17.526546+0000) 2021-08-03T12:46:17.685 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:17.680+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:17.681322+0000) 2021-08-03T12:46:17.722 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:46:17.717+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:17.718379+0000) 2021-08-03T12:46:18.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:18.006+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:18.007204+0000) 2021-08-03T12:46:18.333 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:18.330+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:18.330944+0000) 2021-08-03T12:46:18.352 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:18.348+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:18.349097+0000) 2021-08-03T12:46:18.480 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:18.179+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3534 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:18.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:18.528+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:18.528828+0000) 2021-08-03T12:46:18.685 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:18.681+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:18.681995+0000) 2021-08-03T12:46:18.722 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:46:18.718+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:18.719077+0000) 2021-08-03T12:46:19.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:19.006+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:19.007365+0000) 2021-08-03T12:46:19.112 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:18.972+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:19.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:19.330+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:19.331088+0000) 2021-08-03T12:46:19.353 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:19.348+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:19.349674+0000) 2021-08-03T12:46:19.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:19.528+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:19.529499+0000) 2021-08-03T12:46:19.686 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:19.681+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:19.682571+0000) 2021-08-03T12:46:20.010 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:20.006+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:20.007524+0000) 2021-08-03T12:46:20.354 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:46:20.349+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:20.350264+0000) 2021-08-03T12:46:20.475 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:20.470+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:20.471192+0000) 2021-08-03T12:46:20.616 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:46:20.575+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8228 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:46:20.783 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:20.778+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:20.779011+0000) 2021-08-03T12:46:21.475 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:21.471+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:21.471926+0000) 2021-08-03T12:46:22.032 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:22.028+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:22.029147+0000) 2021-08-03T12:46:22.476 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:22.472+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:22.472918+0000) 2021-08-03T12:46:23.418 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:23.413+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3534 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:23.477 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:23.472+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:23.473541+0000) 2021-08-03T12:46:24.478 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:24.472+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:24.474469+0000) 2021-08-03T12:46:25.479 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:25.473+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:25.475298+0000) 2021-08-03T12:46:26.203 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:26.002+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:26.360 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:46:26.352+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:26.353891+0000) 2021-08-03T12:46:26.480 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:26.474+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:26.476154+0000) 2021-08-03T12:46:27.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:27.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:27.450015+0000) 2021-08-03T12:46:27.480 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:27.475+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:27.476938+0000) 2021-08-03T12:46:28.064 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:28.059+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:28.061122+0000) 2021-08-03T12:46:28.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:28.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:28.450170+0000) 2021-08-03T12:46:28.481 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:28.475+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:28.477591+0000) 2021-08-03T12:46:28.895 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:28.863+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3534 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:28.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:28.895+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:28.897391+0000) 2021-08-03T12:46:29.065 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:29.060+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:29.061780+0000) 2021-08-03T12:46:29.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:29.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:29.450300+0000) 2021-08-03T12:46:29.481 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:29.476+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:29.478423+0000) 2021-08-03T12:46:29.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:29.895+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:29.896811+0000) 2021-08-03T12:46:29.927 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:46:29.643+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8228 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:46:30.065 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:30.060+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:30.062345+0000) 2021-08-03T12:46:30.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:30.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:30.450421+0000) 2021-08-03T12:46:30.483 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:30.477+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:30.479421+0000) 2021-08-03T12:46:30.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:30.895+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:30.896948+0000) 2021-08-03T12:46:31.066 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:31.061+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:31.062901+0000) 2021-08-03T12:46:31.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:31.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:31.450539+0000) 2021-08-03T12:46:31.484 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:31.478+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:31.480659+0000) 2021-08-03T12:46:31.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:31.895+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:31.897125+0000) 2021-08-03T12:46:32.066 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:32.061+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:32.063463+0000) 2021-08-03T12:46:32.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:32.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:32.450646+0000) 2021-08-03T12:46:32.485 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:32.480+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:32.481278+0000) 2021-08-03T12:46:32.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:32.895+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:32.897280+0000) 2021-08-03T12:46:33.068 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:33.063+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:33.065439+0000) 2021-08-03T12:46:33.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:33.448+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:33.450777+0000) 2021-08-03T12:46:33.485 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:33.481+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:33.481873+0000) 2021-08-03T12:46:33.701 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:33.693+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:33.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:33.895+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:33.897438+0000) 2021-08-03T12:46:34.070 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:34.064+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:34.066341+0000) 2021-08-03T12:46:34.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:34.449+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:34.450906+0000) 2021-08-03T12:46:34.486 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:34.481+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:34.482450+0000) 2021-08-03T12:46:34.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:34.896+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:34.897593+0000) 2021-08-03T12:46:35.071 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:35.066+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:35.067450+0000) 2021-08-03T12:46:35.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:35.398+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:35.398825+0000) 2021-08-03T12:46:35.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:35.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:35.451011+0000) 2021-08-03T12:46:35.486 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:35.482+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:35.483367+0000) 2021-08-03T12:46:35.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:35.896+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:35.897723+0000) 2021-08-03T12:46:36.071 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:36.067+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:36.068111+0000) 2021-08-03T12:46:36.454 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:36.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:36.451152+0000) 2021-08-03T12:46:36.487 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:36.483+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:36.483957+0000) 2021-08-03T12:46:36.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:36.897+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:36.897891+0000) 2021-08-03T12:46:37.072 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:37.068+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:37.068719+0000) 2021-08-03T12:46:37.079 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:37.076+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:37.076832+0000) 2021-08-03T12:46:37.154 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:36.693+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3534 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:37.454 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:37.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:37.451293+0000) 2021-08-03T12:46:37.488 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:37.483+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:37.484521+0000) 2021-08-03T12:46:37.837 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:46:36.860+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8230 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:46:37.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:37.897+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:37.898009+0000) 2021-08-03T12:46:38.073 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:38.068+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:38.069347+0000) 2021-08-03T12:46:38.489 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:38.484+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:38.485334+0000) 2021-08-03T12:46:38.641 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:38.635+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:38.636091+0000) 2021-08-03T12:46:38.901 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:38.897+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:38.898140+0000) 2021-08-03T12:46:39.074 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:39.069+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:39.070084+0000) 2021-08-03T12:46:39.489 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:39.485+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:39.486138+0000) 2021-08-03T12:46:39.647 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:39.277+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:39.901 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:39.897+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:39.898274+0000) 2021-08-03T12:46:39.990 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:46:39.986+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:39.987368+0000) 2021-08-03T12:46:40.074 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:40.069+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:40.070706+0000) 2021-08-03T12:46:40.490 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:40.485+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:40.486720+0000) 2021-08-03T12:46:40.678 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:40.673+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:40.674078+0000) 2021-08-03T12:46:40.901 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:40.897+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:40.898458+0000) 2021-08-03T12:46:41.075 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:41.070+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:41.071514+0000) 2021-08-03T12:46:41.491 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:41.486+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:41.487431+0000) 2021-08-03T12:46:41.901 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:41.897+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:41.898599+0000) 2021-08-03T12:46:42.076 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:42.071+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:42.072345+0000) 2021-08-03T12:46:42.491 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:42.487+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:42.488011+0000) 2021-08-03T12:46:42.556 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:42.553+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:42.553924+0000) 2021-08-03T12:46:42.901 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:42.897+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:42.898755+0000) 2021-08-03T12:46:42.937 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:46:42.933+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:42.934858+0000) 2021-08-03T12:46:43.076 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:43.072+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:43.072942+0000) 2021-08-03T12:46:43.492 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:43.487+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:43.488596+0000) 2021-08-03T12:46:43.557 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:43.553+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:43.554070+0000) 2021-08-03T12:46:43.937 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:46:43.934+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:43.935014+0000) 2021-08-03T12:46:44.033 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:44.025+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3545 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:44.077 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:44.072+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:44.073588+0000) 2021-08-03T12:46:44.492 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:44.488+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:44.489166+0000) 2021-08-03T12:46:44.557 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:44.553+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:44.554230+0000) 2021-08-03T12:46:44.794 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:44.790+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:44.791786+0000) 2021-08-03T12:46:44.907 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:46:44.809+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8240 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:46:44.937 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:46:44.934+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:44.935143+0000) 2021-08-03T12:46:45.077 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:45.073+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:45.074194+0000) 2021-08-03T12:46:45.143 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:45.134+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:45.493 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:45.488+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:45.489779+0000) 2021-08-03T12:46:45.557 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:45.553+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:45.554370+0000) 2021-08-03T12:46:46.493 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:46.489+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:46.490371+0000) 2021-08-03T12:46:47.494 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:47.490+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:47.490942+0000) 2021-08-03T12:46:48.495 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:48.490+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:48.491752+0000) 2021-08-03T12:46:49.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:49.353+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:49.354557+0000) 2021-08-03T12:46:49.372 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:49.096+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3553 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:49.495 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:49.491+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:49.492459+0000) 2021-08-03T12:46:50.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:46:50.284+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:50.285663+0000) 2021-08-03T12:46:50.496 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:46:50.492+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:50.493001+0000) 2021-08-03T12:46:50.652 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:50.648+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:50.649221+0000) 2021-08-03T12:46:50.787 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:50.784+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:50.784868+0000) 2021-08-03T12:46:51.652 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:51.648+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:51.649370+0000) 2021-08-03T12:46:51.670 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:51.665+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:51.666009+0000) 2021-08-03T12:46:51.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:51.784+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:51.785024+0000) 2021-08-03T12:46:52.652 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:52.648+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:52.649523+0000) 2021-08-03T12:46:52.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:52.784+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:52.785179+0000) 2021-08-03T12:46:53.046 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:46:53.040+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:46:53.652 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:53.648+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:53.649653+0000) 2021-08-03T12:46:53.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:53.784+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:53.785305+0000) 2021-08-03T12:46:53.898 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:46:53.892+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:46:54.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:54.267+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:54.268758+0000) 2021-08-03T12:46:54.652 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:54.648+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:54.649782+0000) 2021-08-03T12:46:54.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:54.784+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:54.785438+0000) 2021-08-03T12:46:55.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:55.649+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:55.649937+0000) 2021-08-03T12:46:56.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:56.649+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:56.650037+0000) 2021-08-03T12:46:57.555 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:46:57.547+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3553 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:46:57.642 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:46:57.637+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:57.637804+0000) 2021-08-03T12:46:57.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:57.649+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:57.650156+0000) 2021-08-03T12:46:58.517 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:46:58.512+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:58.513727+0000) 2021-08-03T12:46:58.565 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:58.561+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:58.562305+0000) 2021-08-03T12:46:58.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:58.649+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:58.650293+0000) 2021-08-03T12:46:59.417 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:46:59.412+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:59.413240+0000) 2021-08-03T12:46:59.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:59.649+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:59.650433+0000) 2021-08-03T12:46:59.891 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:46:59.887+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:46:59.888128+0000) 2021-08-03T12:47:00.193 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:00.015+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:00.417 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:00.413+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:00.413956+0000) 2021-08-03T12:47:00.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:00.649+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:00.650564+0000) 2021-08-03T12:47:00.891 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:00.887+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:00.888271+0000) 2021-08-03T12:47:01.343 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:01.074+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:01.418 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:01.413+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:01.414577+0000) 2021-08-03T12:47:01.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:01.649+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:01.650680+0000) 2021-08-03T12:47:01.786 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:01.782+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:01.783606+0000) 2021-08-03T12:47:01.891 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:01.887+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:01.888399+0000) 2021-08-03T12:47:02.419 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:02.414+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:02.415464+0000) 2021-08-03T12:47:02.696 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:02.663+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3555 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:02.755 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:02.750+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:02.750879+0000) 2021-08-03T12:47:02.891 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:02.887+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:02.888557+0000) 2021-08-03T12:47:03.420 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:03.415+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:03.416301+0000) 2021-08-03T12:47:03.619 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:03.613+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:03.614755+0000) 2021-08-03T12:47:03.891 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:03.887+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:03.888678+0000) 2021-08-03T12:47:04.420 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:04.416+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:04.416911+0000) 2021-08-03T12:47:04.892 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:04.888+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:04.888827+0000) 2021-08-03T12:47:06.543 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:06.535+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:06.535917+0000) 2021-08-03T12:47:06.865 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:06.843+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8008 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:07.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:07.364+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:07.365078+0000) 2021-08-03T12:47:07.675 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:07.672+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:07.672966+0000) 2021-08-03T12:47:07.710 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:07.702+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3555 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:08.037 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:08.031+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:08.032538+0000) 2021-08-03T12:47:08.073 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:08.036+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:09.404 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:09.400+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:09.401085+0000) 2021-08-03T12:47:09.459 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:09.454+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:09.455084+0000) 2021-08-03T12:47:10.404 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:10.400+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:10.401225+0000) 2021-08-03T12:47:10.459 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:10.454+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:10.455789+0000) 2021-08-03T12:47:10.784 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:10.778+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:10.779402+0000) 2021-08-03T12:47:11.460 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:11.455+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:11.456377+0000) 2021-08-03T12:47:11.759 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:11.754+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:11.755321+0000) 2021-08-03T12:47:11.888 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:11.880+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:11.880846+0000) 2021-08-03T12:47:12.460 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:12.456+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:12.457162+0000) 2021-08-03T12:47:12.885 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:12.880+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:12.881560+0000) 2021-08-03T12:47:13.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:13.415+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:13.416239+0000) 2021-08-03T12:47:13.461 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:13.456+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:13.457733+0000) 2021-08-03T12:47:13.886 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:13.881+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:13.882390+0000) 2021-08-03T12:47:14.062 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:13.881+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8019 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:14.886 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:14.882+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:14.883016+0000) 2021-08-03T12:47:15.887 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:15.883+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:15.883831+0000) 2021-08-03T12:47:15.938 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:15.934+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:15.935509+0000) 2021-08-03T12:47:16.250 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:16.138+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3555 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:16.481 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:16.475+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:16.476094+0000) 2021-08-03T12:47:16.482 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:16.478+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:16.480068+0000) 2021-08-03T12:47:16.888 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:16.883+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:16.884422+0000) 2021-08-03T12:47:16.938 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:16.934+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:16.935667+0000) 2021-08-03T12:47:17.888 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:17.884+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:17.885009+0000) 2021-08-03T12:47:17.938 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:17.934+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:17.935800+0000) 2021-08-03T12:47:18.889 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:18.884+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:18.885618+0000) 2021-08-03T12:47:18.938 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:18.935+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:18.935936+0000) 2021-08-03T12:47:19.114 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:19.108+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:19.109638+0000) 2021-08-03T12:47:19.352 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:19.278+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:19.939 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:19.935+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:19.936074+0000) 2021-08-03T12:47:20.314 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:19.928+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8022 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:21.163 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:21.158+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:21.160368+0000) 2021-08-03T12:47:21.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:21.524+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:21.526643+0000) 2021-08-03T12:47:22.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:22.525+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:22.526893+0000) 2021-08-03T12:47:23.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:23.525+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:23.527003+0000) 2021-08-03T12:47:24.307 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:24.302+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:24.356 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:23.526+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3556 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:24.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:24.526+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:24.527133+0000) 2021-08-03T12:47:25.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:25.526+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:25.527271+0000) 2021-08-03T12:47:25.933 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:25.928+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:25.928952+0000) 2021-08-03T12:47:26.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:26.526+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:26.527403+0000) 2021-08-03T12:47:27.159 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:27.153+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:27.154351+0000) 2021-08-03T12:47:27.314 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:27.310+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:27.311202+0000) 2021-08-03T12:47:27.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:27.526+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:27.527556+0000) 2021-08-03T12:47:28.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:28.526+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:28.527710+0000) 2021-08-03T12:47:28.614 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:28.609+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8022 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:28.655 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:28.650+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:28.650795+0000) 2021-08-03T12:47:28.896 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:28.892+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:28.893144+0000) 2021-08-03T12:47:29.122 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:29.118+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:29.119456+0000) 2021-08-03T12:47:29.171 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:29.165+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:29.166345+0000) 2021-08-03T12:47:29.174 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:29.170+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:29.171805+0000) 2021-08-03T12:47:29.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:29.527+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:29.527828+0000) 2021-08-03T12:47:29.656 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:29.413+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:30.020 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:30.015+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:30.016003+0000) 2021-08-03T12:47:30.122 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:30.118+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:30.119649+0000) 2021-08-03T12:47:30.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:30.527+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:30.527968+0000) 2021-08-03T12:47:30.711 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:30.705+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:30.706176+0000) 2021-08-03T12:47:31.021 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:31.015+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:31.016759+0000) 2021-08-03T12:47:31.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:31.119+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:31.119849+0000) 2021-08-03T12:47:31.531 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:31.527+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:31.528131+0000) 2021-08-03T12:47:31.848 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:31.542+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3583 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:32.165 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:32.160+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:32.160885+0000) 2021-08-03T12:47:32.184 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:32.179+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:32.180124+0000) 2021-08-03T12:47:32.736 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:32.731+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:32.731716+0000) 2021-08-03T12:47:32.753 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:32.749+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:32.750474+0000) 2021-08-03T12:47:35.228 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:35.223+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:35.224093+0000) 2021-08-03T12:47:35.245 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:35.241+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:35.241948+0000) 2021-08-03T12:47:35.404 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:35.300+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:35.583 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:35.579+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:35.580089+0000) 2021-08-03T12:47:36.012 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:36.008+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:36.009437+0000) 2021-08-03T12:47:36.727 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:36.390+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8025 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:36.878 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:36.872+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:36.873723+0000) 2021-08-03T12:47:37.189 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:37.186+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:37.186825+0000) 2021-08-03T12:47:37.752 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:37.745+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:37.747670+0000) 2021-08-03T12:47:37.773 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:37.767+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:37.769157+0000) 2021-08-03T12:47:37.806 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:37.801+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:37.801948+0000) 2021-08-03T12:47:38.473 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:38.467+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:38.469308+0000) 2021-08-03T12:47:38.475 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:38.258+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3589 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:38.477 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:38.472+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:38.472906+0000) 2021-08-03T12:47:38.648 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:38.642+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:38.644466+0000) 2021-08-03T12:47:38.761 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:38.757+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:38.757720+0000) 2021-08-03T12:47:39.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:39.222+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:39.222866+0000) 2021-08-03T12:47:39.281 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:39.277+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:39.278534+0000) 2021-08-03T12:47:39.605 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:39.585+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:39.587765+0000) 2021-08-03T12:47:39.709 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:39.674+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:39.676208+0000) 2021-08-03T12:47:39.763 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:39.758+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:39.758925+0000) 2021-08-03T12:47:40.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:40.222+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:40.223015+0000) 2021-08-03T12:47:40.592 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:40.586+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:40.588507+0000) 2021-08-03T12:47:40.691 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:40.685+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:40.687251+0000) 2021-08-03T12:47:40.763 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:40.758+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:40.759557+0000) 2021-08-03T12:47:40.864 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:40.859+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:40.861299+0000) 2021-08-03T12:47:41.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:41.222+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:41.223135+0000) 2021-08-03T12:47:41.254 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:41.250+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:41.250950+0000) 2021-08-03T12:47:41.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:41.263+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:41.264167+0000) 2021-08-03T12:47:41.289 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:41.283+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:41.284141+0000) 2021-08-03T12:47:41.593 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:41.588+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:41.589798+0000) 2021-08-03T12:47:41.691 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:41.685+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:41.687799+0000) 2021-08-03T12:47:41.764 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:41.759+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:41.760202+0000) 2021-08-03T12:47:42.150 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:42.144+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:42.145796+0000) 2021-08-03T12:47:42.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:42.222+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:42.223300+0000) 2021-08-03T12:47:42.594 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:42.588+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:42.590376+0000) 2021-08-03T12:47:42.692 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:42.686+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:42.688373+0000) 2021-08-03T12:47:42.764 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:42.760+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:42.760803+0000) 2021-08-03T12:47:43.150 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:43.145+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:43.146805+0000) 2021-08-03T12:47:43.224 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:43.216+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:43.396 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:43.310+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8025 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:43.618 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:43.614+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:43.615451+0000) 2021-08-03T12:47:43.765 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:43.760+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:43.761398+0000) 2021-08-03T12:47:43.895 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:43.891+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:43.892363+0000) 2021-08-03T12:47:44.151 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:44.145+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:44.147415+0000) 2021-08-03T12:47:44.766 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:44.761+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:44.762364+0000) 2021-08-03T12:47:45.151 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:45.147+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:45.148002+0000) 2021-08-03T12:47:45.767 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:45.762+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:45.763322+0000) 2021-08-03T12:47:45.947 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:45.941+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:45.942481+0000) 2021-08-03T12:47:45.959 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:47:45.953+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:45.954166+0000) 2021-08-03T12:47:46.044 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:46.005+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3596 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:46.053 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:46.048+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:46.049584+0000) 2021-08-03T12:47:46.059 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:46.053+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:46.054698+0000) 2021-08-03T12:47:46.152 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:46.147+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:46.148649+0000) 2021-08-03T12:47:46.606 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:46.600+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:46.601395+0000) 2021-08-03T12:47:46.767 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:46.763+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:46.763955+0000) 2021-08-03T12:47:47.153 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:47.148+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:47.149453+0000) 2021-08-03T12:47:48.154 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:48.149+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:48.150619+0000) 2021-08-03T12:47:49.050 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:49.046+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:49.047076+0000) 2021-08-03T12:47:49.154 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:49.150+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:49.151172+0000) 2021-08-03T12:47:49.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:49.209+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:49.210485+0000) 2021-08-03T12:47:49.483 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:49.453+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8025 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:49.550 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:49.546+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:49.546928+0000) 2021-08-03T12:47:49.737 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:49.732+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:49.733301+0000) 2021-08-03T12:47:49.900 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:49.893+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:49.970 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:49.965+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:49.966080+0000) 2021-08-03T12:47:50.155 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:50.150+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.151722+0000) 2021-08-03T12:47:50.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:50.403+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.403922+0000) 2021-08-03T12:47:50.416 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:50.412+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.413503+0000) 2021-08-03T12:47:50.534 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:50.530+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.531063+0000) 2021-08-03T12:47:50.695 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:50.690+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.691519+0000) 2021-08-03T12:47:50.738 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:50.733+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.733983+0000) 2021-08-03T12:47:50.743 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:50.739+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.739761+0000) 2021-08-03T12:47:50.939 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:50.935+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:50.936440+0000) 2021-08-03T12:47:51.156 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:51.151+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.152274+0000) 2021-08-03T12:47:51.500 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:47:51.494+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.495699+0000) 2021-08-03T12:47:51.536 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:51.532+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.533396+0000) 2021-08-03T12:47:51.695 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:51.691+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.692070+0000) 2021-08-03T12:47:51.738 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:51.734+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.734776+0000) 2021-08-03T12:47:51.744 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:51.740+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.740735+0000) 2021-08-03T12:47:51.939 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:51.935+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.936565+0000) 2021-08-03T12:47:51.942 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:51.938+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:51.939237+0000) 2021-08-03T12:47:52.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:52.119+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.120143+0000) 2021-08-03T12:47:52.156 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:52.152+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.152845+0000) 2021-08-03T12:47:52.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:52.268+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.269433+0000) 2021-08-03T12:47:52.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:52.534+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.535779+0000) 2021-08-03T12:47:52.696 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:52.691+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.692666+0000) 2021-08-03T12:47:52.739 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:52.734+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.735370+0000) 2021-08-03T12:47:52.744 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:52.740+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.741304+0000) 2021-08-03T12:47:52.939 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:52.935+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:52.936717+0000) 2021-08-03T12:47:53.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:53.119+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:53.120305+0000) 2021-08-03T12:47:53.157 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:53.152+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:53.153547+0000) 2021-08-03T12:47:53.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:53.536+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:53.537137+0000) 2021-08-03T12:47:53.697 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:53.692+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:53.693229+0000) 2021-08-03T12:47:53.739 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:53.735+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:53.736001+0000) 2021-08-03T12:47:53.745 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:53.741+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:53.741882+0000) 2021-08-03T12:47:53.939 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:53.935+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:53.936854+0000) 2021-08-03T12:47:54.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:54.119+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:54.120449+0000) 2021-08-03T12:47:54.158 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:54.153+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:54.154346+0000) 2021-08-03T12:47:54.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:54.536+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:54.537364+0000) 2021-08-03T12:47:54.697 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:54.693+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:54.693772+0000) 2021-08-03T12:47:54.740 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:54.735+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:54.736619+0000) 2021-08-03T12:47:54.746 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:54.741+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:54.742485+0000) 2021-08-03T12:47:54.940 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:54.936+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:54.937006+0000) 2021-08-03T12:47:55.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:55.119+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:55.120555+0000) 2021-08-03T12:47:55.158 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:55.154+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:55.154958+0000) 2021-08-03T12:47:55.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:55.536+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:55.537544+0000) 2021-08-03T12:47:55.698 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:55.693+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:55.694352+0000) 2021-08-03T12:47:55.740 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:55.736+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:55.737171+0000) 2021-08-03T12:47:55.746 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:55.742+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:55.743068+0000) 2021-08-03T12:47:55.940 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:55.936+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:55.937136+0000) 2021-08-03T12:47:56.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:56.119+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:56.120711+0000) 2021-08-03T12:47:56.159 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:56.154+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:56.155739+0000) 2021-08-03T12:47:56.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:56.536+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:56.537735+0000) 2021-08-03T12:47:56.698 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:56.694+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:56.694924+0000) 2021-08-03T12:47:56.741 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:47:56.736+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:56.737678+0000) 2021-08-03T12:47:56.816 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:47:56.812+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3599 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:47:56.940 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:56.936+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:56.937277+0000) 2021-08-03T12:47:56.980 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:47:56.974+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:56.975627+0000) 2021-08-03T12:47:57.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:57.120+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:57.120855+0000) 2021-08-03T12:47:57.144 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:47:57.123+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8027 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:47:57.160 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:57.155+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:57.156499+0000) 2021-08-03T12:47:57.699 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:47:57.694+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:57.695574+0000) 2021-08-03T12:47:57.940 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:47:57.936+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:57.937418+0000) 2021-08-03T12:47:57.978 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:47:57.973+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:57.973865+0000) 2021-08-03T12:47:58.160 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:58.156+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:58.156997+0000) 2021-08-03T12:47:58.298 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:47:58.292+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:58.293256+0000) 2021-08-03T12:47:58.578 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:47:58.273+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8253 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:47:58.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:47:58.684+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:58.685114+0000) 2021-08-03T12:47:59.161 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:47:59.157+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:47:59.157959+0000) 2021-08-03T12:48:00.162 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:00.157+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:00.158497+0000) 2021-08-03T12:48:00.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:00.226+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:00.227367+0000) 2021-08-03T12:48:00.341 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:00.337+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:00.338772+0000) 2021-08-03T12:48:00.599 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:00.593+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:00.594591+0000) 2021-08-03T12:48:01.163 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:01.158+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:01.159069+0000) 2021-08-03T12:48:01.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:01.267+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:01.268752+0000) 2021-08-03T12:48:01.373 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:01.369+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:01.370850+0000) 2021-08-03T12:48:01.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:01.528+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:01.529345+0000) 2021-08-03T12:48:01.919 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:01.914+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:01.915290+0000) 2021-08-03T12:48:02.163 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:02.159+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:02.159882+0000) 2021-08-03T12:48:02.228 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:02.223+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:02.224443+0000) 2021-08-03T12:48:02.335 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:02.330+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:02.330964+0000) 2021-08-03T12:48:02.384 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:02.178+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3609 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:02.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:02.528+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:02.529492+0000) 2021-08-03T12:48:03.309 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:03.304+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:03.305403+0000) 2021-08-03T12:48:04.620 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:04.310+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8027 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:04.671 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:04.635+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8266 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:05.821 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:05.816+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:05.816978+0000) 2021-08-03T12:48:06.166 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:06.161+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:06.163213+0000) 2021-08-03T12:48:06.670 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:06.663+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:06.664627+0000) 2021-08-03T12:48:07.252 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:07.247+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:07.248072+0000) 2021-08-03T12:48:07.264 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:07.219+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3610 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:07.669 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:07.664+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:07.665398+0000) 2021-08-03T12:48:07.771 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:07.765+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:07.767335+0000) 2021-08-03T12:48:07.904 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:07.899+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:07.901343+0000) 2021-08-03T12:48:08.252 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:08.248+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:08.248805+0000) 2021-08-03T12:48:08.670 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:08.665+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:08.666030+0000) 2021-08-03T12:48:08.771 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:08.766+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:08.768094+0000) 2021-08-03T12:48:09.253 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:09.248+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:09.249378+0000) 2021-08-03T12:48:09.671 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:09.666+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:09.667618+0000) 2021-08-03T12:48:09.684 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:48:09.678+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:09.679802+0000) 2021-08-03T12:48:09.772 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:09.766+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:09.768663+0000) 2021-08-03T12:48:09.912 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:09.907+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:09.909140+0000) 2021-08-03T12:48:10.253 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:10.249+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:10.249960+0000) 2021-08-03T12:48:10.335 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:10.237+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8027 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:10.674 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:10.669+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:10.669350+0000) 2021-08-03T12:48:10.772 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:10.767+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:10.769237+0000) 2021-08-03T12:48:11.454 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:11.450+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:11.450908+0000) 2021-08-03T12:48:11.556 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:11.535+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8278 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:11.558 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:11.551+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:11.553701+0000) 2021-08-03T12:48:11.675 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:11.670+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:11.671130+0000) 2021-08-03T12:48:12.007 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:12.002+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:12.002953+0000) 2021-08-03T12:48:12.368 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:12.359+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:12.359817+0000) 2021-08-03T12:48:12.665 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:12.660+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:12.662004+0000) 2021-08-03T12:48:12.676 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:12.671+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:12.672322+0000) 2021-08-03T12:48:13.234 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:13.228+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:13.230064+0000) 2021-08-03T12:48:13.601 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:13.596+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:13.597046+0000) 2021-08-03T12:48:13.657 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:13.653+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:13.654854+0000) 2021-08-03T12:48:13.677 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:13.672+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:13.673380+0000) 2021-08-03T12:48:13.697 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:13.692+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:13.693718+0000) 2021-08-03T12:48:13.947 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:13.940+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3610 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:14.489 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:14.485+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:14.486479+0000) 2021-08-03T12:48:14.599 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:14.595+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:14.596209+0000) 2021-08-03T12:48:14.601 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:14.596+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:14.597749+0000) 2021-08-03T12:48:14.658 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:14.654+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:14.654989+0000) 2021-08-03T12:48:14.698 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:14.693+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:14.694414+0000) 2021-08-03T12:48:15.602 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:15.597+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:15.598378+0000) 2021-08-03T12:48:15.658 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:15.654+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:15.655102+0000) 2021-08-03T12:48:15.699 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:15.694+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:15.694980+0000) 2021-08-03T12:48:16.603 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:16.598+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:16.598944+0000) 2021-08-03T12:48:16.658 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:16.654+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:16.655235+0000) 2021-08-03T12:48:16.699 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:16.694+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:16.695518+0000) 2021-08-03T12:48:16.999 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:16.993+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:16.994253+0000) 2021-08-03T12:48:17.603 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:17.598+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:17.599691+0000) 2021-08-03T12:48:17.664 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:17.654+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:17.655364+0000) 2021-08-03T12:48:17.699 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:17.695+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:17.696105+0000) 2021-08-03T12:48:18.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:18.120+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:18.121265+0000) 2021-08-03T12:48:18.304 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:18.296+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8028 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:18.553 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:18.549+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:18.550360+0000) 2021-08-03T12:48:18.588 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:18.551+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8278 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:18.658 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:18.654+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:18.655494+0000) 2021-08-03T12:48:18.700 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:18.695+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:18.696690+0000) 2021-08-03T12:48:19.658 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:19.654+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:19.655651+0000) 2021-08-03T12:48:19.916 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:19.910+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:19.911588+0000) 2021-08-03T12:48:19.965 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:48:19.960+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:19.961343+0000) 2021-08-03T12:48:20.641 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:20.636+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:20.637340+0000) 2021-08-03T12:48:20.643 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:20.639+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:20.640735+0000) 2021-08-03T12:48:21.138 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:21.134+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3622 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:21.414 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:21.408+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:21.409616+0000) 2021-08-03T12:48:21.430 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:21.426+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:21.427204+0000) 2021-08-03T12:48:21.744 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:21.739+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:21.740360+0000) 2021-08-03T12:48:21.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:21.966+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:21.967136+0000) 2021-08-03T12:48:21.977 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:21.973+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:21.974069+0000) 2021-08-03T12:48:22.431 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:22.426+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:22.427789+0000) 2021-08-03T12:48:23.435 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:23.427+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:23.428386+0000) 2021-08-03T12:48:24.437 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:24.432+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:24.433114+0000) 2021-08-03T12:48:24.701 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:24.696+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:24.697335+0000) 2021-08-03T12:48:24.846 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:24.563+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8040 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:25.437 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:25.432+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:25.433774+0000) 2021-08-03T12:48:26.558 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:26.389+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8278 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:26.560 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:26.555+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:26.556431+0000) 2021-08-03T12:48:26.750 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:48:26.746+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:26.746893+0000) 2021-08-03T12:48:27.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:27.537+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:27.538145+0000) 2021-08-03T12:48:27.745 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:27.740+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:27.741441+0000) 2021-08-03T12:48:27.752 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:48:27.746+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:27.747583+0000) 2021-08-03T12:48:28.428 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:28.421+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:28.422586+0000) 2021-08-03T12:48:28.702 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:28.698+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:28.699002+0000) 2021-08-03T12:48:28.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:28.705+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:28.706149+0000) 2021-08-03T12:48:28.745 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:28.741+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:28.742138+0000) 2021-08-03T12:48:28.790 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:28.785+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3623 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:29.704 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:29.699+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:29.699916+0000) 2021-08-03T12:48:29.746 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:29.742+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:29.742899+0000) 2021-08-03T12:48:30.135 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:30.131+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:30.132003+0000) 2021-08-03T12:48:30.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:30.711+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:30.712358+0000) 2021-08-03T12:48:30.747 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:30.742+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:30.743485+0000) 2021-08-03T12:48:30.950 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:30.945+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:30.945997+0000) 2021-08-03T12:48:31.747 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:31.743+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:31.744087+0000) 2021-08-03T12:48:31.777 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:31.772+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:31.773572+0000) 2021-08-03T12:48:32.223 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:48:32.217+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:32.218153+0000) 2021-08-03T12:48:32.748 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:32.744+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:32.744989+0000) 2021-08-03T12:48:32.778 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:32.773+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:32.774304+0000) 2021-08-03T12:48:33.192 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:33.187+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:33.188484+0000) 2021-08-03T12:48:33.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:33.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:33.223860+0000) 2021-08-03T12:48:33.338 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:33.334+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:33.334923+0000) 2021-08-03T12:48:33.749 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:33.744+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:33.745577+0000) 2021-08-03T12:48:33.775 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:33.704+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8278 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:33.778 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:33.774+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:33.774886+0000) 2021-08-03T12:48:33.919 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:33.914+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8050 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:34.192 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:34.188+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:34.189066+0000) 2021-08-03T12:48:34.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:34.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:34.224007+0000) 2021-08-03T12:48:34.257 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:34.251+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:34.252614+0000) 2021-08-03T12:48:35.193 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:35.188+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:35.189733+0000) 2021-08-03T12:48:35.197 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:35.191+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:35.192661+0000) 2021-08-03T12:48:36.006 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:36.002+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:36.003803+0000) 2021-08-03T12:48:36.194 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:36.189+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:36.190307+0000) 2021-08-03T12:48:36.269 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:36.237+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3643 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:36.331 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:36.326+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:36.327408+0000) 2021-08-03T12:48:36.784 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:36.778+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:36.779106+0000) 2021-08-03T12:48:36.999 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:36.995+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:36.996644+0000) 2021-08-03T12:48:37.194 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:37.190+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:37.190835+0000) 2021-08-03T12:48:38.177 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:38.171+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:38.171906+0000) 2021-08-03T12:48:38.383 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:38.379+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:38.379956+0000) 2021-08-03T12:48:39.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:39.734+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:39.735008+0000) 2021-08-03T12:48:39.793 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:39.787+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:39.788327+0000) 2021-08-03T12:48:40.101 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:40.095+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:40.096255+0000) 2021-08-03T12:48:40.377 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:40.325+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8278 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:40.605 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:40.600+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8054 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:40.683 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:40.679+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:40.680683+0000) 2021-08-03T12:48:40.984 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:48:40.979+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:40.979804+0000) 2021-08-03T12:48:41.762 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:41.756+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:41.757180+0000) 2021-08-03T12:48:41.953 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:41.946+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:41.947072+0000) 2021-08-03T12:48:42.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:42.526+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:42.526999+0000) 2021-08-03T12:48:42.769 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:42.765+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:42.766185+0000) 2021-08-03T12:48:42.827 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:42.822+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:42.822931+0000) 2021-08-03T12:48:43.007 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:43.003+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:43.003943+0000) 2021-08-03T12:48:44.064 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:44.059+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:44.060226+0000) 2021-08-03T12:48:44.192 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:44.187+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:44.188108+0000) 2021-08-03T12:48:44.327 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:44.293+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3652 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:44.948 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:44.943+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:44.944632+0000) 2021-08-03T12:48:45.949 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:45.944+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:45.945303+0000) 2021-08-03T12:48:45.971 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:45.967+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:45.968727+0000) 2021-08-03T12:48:46.950 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:46.945+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:46.946340+0000) 2021-08-03T12:48:46.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:46.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:46.968898+0000) 2021-08-03T12:48:47.950 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:47.945+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:47.946909+0000) 2021-08-03T12:48:47.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:47.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:47.969049+0000) 2021-08-03T12:48:48.607 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:48.601+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:48.603341+0000) 2021-08-03T12:48:48.951 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:48.945+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:48.947477+0000) 2021-08-03T12:48:48.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:48.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:48.969177+0000) 2021-08-03T12:48:49.608 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:49.602+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:49.604095+0000) 2021-08-03T12:48:49.704 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:49.699+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:49.700906+0000) 2021-08-03T12:48:49.952 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:49.946+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:49.948229+0000) 2021-08-03T12:48:49.956 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:49.950+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:49.952756+0000) 2021-08-03T12:48:49.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:49.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:49.969340+0000) 2021-08-03T12:48:50.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:49.787+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8060 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:50.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:48:50.186+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:50.186839+0000) 2021-08-03T12:48:50.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:50.468+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:50.469017+0000) 2021-08-03T12:48:50.483 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:50.113+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8297 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:50.609 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:50.603+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:50.605656+0000) 2021-08-03T12:48:50.705 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:50.699+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:50.701648+0000) 2021-08-03T12:48:50.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:50.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:50.969473+0000) 2021-08-03T12:48:51.277 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:51.273+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:51.274628+0000) 2021-08-03T12:48:51.610 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:51.604+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:51.606619+0000) 2021-08-03T12:48:51.705 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:51.700+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:51.702236+0000) 2021-08-03T12:48:51.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:51.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:51.969618+0000) 2021-08-03T12:48:52.611 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:52.605+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:52.607565+0000) 2021-08-03T12:48:52.708 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:52.701+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:52.703629+0000) 2021-08-03T12:48:52.972 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:52.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:52.969763+0000) 2021-08-03T12:48:53.027 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:48:52.996+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3659 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:48:53.308 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:53.303+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:53.305032+0000) 2021-08-03T12:48:53.349 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:53.342+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:53.344253+0000) 2021-08-03T12:48:53.708 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:53.702+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:53.704649+0000) 2021-08-03T12:48:53.770 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:48:53.765+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:53.766200+0000) 2021-08-03T12:48:53.973 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:53.969+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:53.969898+0000) 2021-08-03T12:48:54.051 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:54.047+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:54.047855+0000) 2021-08-03T12:48:54.355 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:48:54.348+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:54.350250+0000) 2021-08-03T12:48:54.709 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:54.704+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:54.705910+0000) 2021-08-03T12:48:54.793 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:54.788+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:54.788951+0000) 2021-08-03T12:48:54.973 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:54.969+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:54.970032+0000) 2021-08-03T12:48:54.988 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:48:54.981+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:54.983626+0000) 2021-08-03T12:48:55.676 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:48:55.670+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:55.671747+0000) 2021-08-03T12:48:55.710 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:55.706+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:55.706851+0000) 2021-08-03T12:48:55.973 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:55.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:55.970171+0000) 2021-08-03T12:48:56.436 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:48:56.052+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8060 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:48:56.711 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:56.707+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:56.707796+0000) 2021-08-03T12:48:56.800 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:48:56.794+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:56.796282+0000) 2021-08-03T12:48:56.973 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:56.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:56.970332+0000) 2021-08-03T12:48:57.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:57.536+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:57.538452+0000) 2021-08-03T12:48:57.707 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:48:57.703+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:57.703820+0000) 2021-08-03T12:48:57.712 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:57.708+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:57.709018+0000) 2021-08-03T12:48:57.973 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:57.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:57.970490+0000) 2021-08-03T12:48:58.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:58.539+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:58.540959+0000) 2021-08-03T12:48:58.715 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:58.709+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:58.710380+0000) 2021-08-03T12:48:58.941 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:58.937+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:58.938220+0000) 2021-08-03T12:48:58.973 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:58.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:58.970642+0000) 2021-08-03T12:48:59.113 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:48:59.029+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8312 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:48:59.716 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:48:59.711+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:59.711669+0000) 2021-08-03T12:48:59.941 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:48:59.937+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:59.938370+0000) 2021-08-03T12:48:59.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:48:59.968+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:48:59.970768+0000) 2021-08-03T12:49:00.356 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:00.351+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:00.351968+0000) 2021-08-03T12:49:00.708 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:00.703+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:00.704926+0000) 2021-08-03T12:49:00.718 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:00.713+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:00.713897+0000) 2021-08-03T12:49:00.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:00.824+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:00.826164+0000) 2021-08-03T12:49:00.941 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:00.937+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:00.938513+0000) 2021-08-03T12:49:00.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:00.969+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:00.970905+0000) 2021-08-03T12:49:01.175 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:01.169+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:01.170237+0000) 2021-08-03T12:49:01.230 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:01.223+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:01.224941+0000) 2021-08-03T12:49:01.709 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:01.703+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:01.705650+0000) 2021-08-03T12:49:01.720 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:01.715+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:01.715370+0000) 2021-08-03T12:49:01.941 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:01.937+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:01.938643+0000) 2021-08-03T12:49:01.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:01.969+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:01.971015+0000) 2021-08-03T12:49:02.016 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:02.011+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:02.013567+0000) 2021-08-03T12:49:02.040 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:01.928+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8060 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:02.043 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:01.618+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3665 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:02.049 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:02.044+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:02.046088+0000) 2021-08-03T12:49:02.710 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:02.704+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:02.706457+0000) 2021-08-03T12:49:02.721 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:02.716+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:02.717308+0000) 2021-08-03T12:49:02.941 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:02.937+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:02.938793+0000) 2021-08-03T12:49:02.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:02.969+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:02.971171+0000) 2021-08-03T12:49:03.277 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:03.271+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:03.272787+0000) 2021-08-03T12:49:03.711 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:03.705+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:03.707068+0000) 2021-08-03T12:49:03.722 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:03.717+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:03.718390+0000) 2021-08-03T12:49:03.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:03.969+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:03.971266+0000) 2021-08-03T12:49:04.711 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:04.706+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:04.707649+0000) 2021-08-03T12:49:04.723 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:04.718+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:04.719592+0000) 2021-08-03T12:49:04.753 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:04.748+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:04.749565+0000) 2021-08-03T12:49:04.951 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:04.945+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8331 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:04.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:04.970+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:04.971403+0000) 2021-08-03T12:49:04.986 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:04.982+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:04.983603+0000) 2021-08-03T12:49:05.725 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:05.720+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:05.721344+0000) 2021-08-03T12:49:05.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:05.970+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:05.971569+0000) 2021-08-03T12:49:06.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:06.505+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:06.506476+0000) 2021-08-03T12:49:06.727 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:06.721+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:06.722699+0000) 2021-08-03T12:49:06.733 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:06.727+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:06.728271+0000) 2021-08-03T12:49:06.975 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:06.970+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:06.971723+0000) 2021-08-03T12:49:06.982 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:06.977+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:06.977994+0000) 2021-08-03T12:49:07.230 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:07.225+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:07.226298+0000) 2021-08-03T12:49:07.728 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:07.723+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:07.724129+0000) 2021-08-03T12:49:07.757 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:07.752+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:07.753463+0000) 2021-08-03T12:49:07.829 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:07.823+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3667 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:07.836 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:07.830+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:07.831547+0000) 2021-08-03T12:49:07.975 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:07.971+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:07.971886+0000) 2021-08-03T12:49:08.285 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:08.157+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8060 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:08.292 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:08.286+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:08.287548+0000) 2021-08-03T12:49:08.728 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:08.724+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:08.725120+0000) 2021-08-03T12:49:08.975 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:08.971+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:08.972000+0000) 2021-08-03T12:49:09.197 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:09.193+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:09.194185+0000) 2021-08-03T12:49:09.730 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:09.725+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:09.726094+0000) 2021-08-03T12:49:09.975 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:09.971+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:09.972125+0000) 2021-08-03T12:49:10.141 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:10.135+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:10.136418+0000) 2021-08-03T12:49:10.203 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:10.128+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8347 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:10.208 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:10.205+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:10.205956+0000) 2021-08-03T12:49:11.567 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:11.563+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:11.564537+0000) 2021-08-03T12:49:12.918 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:12.912+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:12.913504+0000) 2021-08-03T12:49:13.156 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:13.152+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:13.153278+0000) 2021-08-03T12:49:13.525 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:13.520+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:13.521050+0000) 2021-08-03T12:49:15.316 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:15.232+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3671 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:15.595 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:15.415+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8067 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:16.234 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:16.228+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:16.229190+0000) 2021-08-03T12:49:16.241 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:16.235+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:16.236301+0000) 2021-08-03T12:49:16.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:16.451+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:16.451988+0000) 2021-08-03T12:49:17.172 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:17.167+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:17.168007+0000) 2021-08-03T12:49:17.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:17.721+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:17.722520+0000) 2021-08-03T12:49:17.844 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:17.838+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:17.839545+0000) 2021-08-03T12:49:17.882 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:17.833+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8371 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:18.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:18.814+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:18.815550+0000) 2021-08-03T12:49:20.008 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:20.004+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:20.005799+0000) 2021-08-03T12:49:20.218 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:20.213+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:20.214209+0000) 2021-08-03T12:49:20.408 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:20.402+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:20.403061+0000) 2021-08-03T12:49:20.411 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:20.405+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:20.406358+0000) 2021-08-03T12:49:20.705 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:20.699+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:20.699994+0000) 2021-08-03T12:49:21.057 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:21.053+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:21.054708+0000) 2021-08-03T12:49:22.435 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:22.359+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8067 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:22.511 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:22.507+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:22.508725+0000) 2021-08-03T12:49:23.146 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:23.122+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3675 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:23.153 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:23.148+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:23.148811+0000) 2021-08-03T12:49:23.617 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:23.611+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:23.612743+0000) 2021-08-03T12:49:24.068 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:24.063+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:24.064685+0000) 2021-08-03T12:49:24.509 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:24.502+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8381 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:24.617 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:24.612+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:24.613722+0000) 2021-08-03T12:49:24.885 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:24.881+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:24.882403+0000) 2021-08-03T12:49:25.069 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:25.064+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:25.065584+0000) 2021-08-03T12:49:25.274 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:25.269+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:25.269900+0000) 2021-08-03T12:49:25.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:25.472+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:25.472926+0000) 2021-08-03T12:49:25.589 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:25.583+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:25.584458+0000) 2021-08-03T12:49:26.070 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:26.065+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:26.066422+0000) 2021-08-03T12:49:26.102 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:26.097+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:26.098314+0000) 2021-08-03T12:49:26.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:26.472+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:26.473054+0000) 2021-08-03T12:49:26.545 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:26.540+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:26.541203+0000) 2021-08-03T12:49:26.868 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:26.862+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:26.863446+0000) 2021-08-03T12:49:27.070 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:27.066+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:27.066996+0000) 2021-08-03T12:49:27.287 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:27.283+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:27.284513+0000) 2021-08-03T12:49:27.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:27.472+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:27.473181+0000) 2021-08-03T12:49:27.589 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:27.583+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8067 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:27.591 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:27.588+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:27.588885+0000) 2021-08-03T12:49:28.071 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:28.066+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:28.067558+0000) 2021-08-03T12:49:28.080 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:28.076+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:28.077449+0000) 2021-08-03T12:49:28.108 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:28.104+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:28.105220+0000) 2021-08-03T12:49:28.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:28.472+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:28.473315+0000) 2021-08-03T12:49:28.759 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:28.754+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:28.755561+0000) 2021-08-03T12:49:29.072 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:29.067+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:29.068337+0000) 2021-08-03T12:49:29.244 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:28.892+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3678 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:29.471 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:29.465+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:29.466630+0000) 2021-08-03T12:49:29.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:29.472+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:29.473485+0000) 2021-08-03T12:49:29.547 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:29.543+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:29.543877+0000) 2021-08-03T12:49:29.760 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:29.755+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:29.756323+0000) 2021-08-03T12:49:30.120 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:29.933+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8387 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:30.254 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:30.248+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:30.249576+0000) 2021-08-03T12:49:30.270 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:30.265+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:30.266525+0000) 2021-08-03T12:49:30.549 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:30.545+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:30.546430+0000) 2021-08-03T12:49:31.160 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:31.155+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:31.156021+0000) 2021-08-03T12:49:31.168 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:31.164+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:31.165326+0000) 2021-08-03T12:49:32.524 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:32.519+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:32.520023+0000) 2021-08-03T12:49:32.962 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:32.956+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:32.957200+0000) 2021-08-03T12:49:33.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:33.538+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:33.538896+0000) 2021-08-03T12:49:33.942 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:33.938+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:33.939125+0000) 2021-08-03T12:49:34.167 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:33.918+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3679 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:34.618 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:34.498+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8067 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:34.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:34.697+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:34.698730+0000) 2021-08-03T12:49:34.812 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:34.808+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:34.809740+0000) 2021-08-03T12:49:34.942 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:34.938+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:34.939264+0000) 2021-08-03T12:49:35.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:35.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.224615+0000) 2021-08-03T12:49:35.331 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:35.325+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.325966+0000) 2021-08-03T12:49:35.339 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:35.333+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.334597+0000) 2021-08-03T12:49:35.340 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:35.336+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.337711+0000) 2021-08-03T12:49:35.632 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:35.341+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8405 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:35.719 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:35.713+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.714384+0000) 2021-08-03T12:49:35.757 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:35.753+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.753981+0000) 2021-08-03T12:49:35.883 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:35.877+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.878550+0000) 2021-08-03T12:49:35.943 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:35.937+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:35.938257+0000) 2021-08-03T12:49:36.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:36.223+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:36.224750+0000) 2021-08-03T12:49:36.758 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:36.753+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:36.754547+0000) 2021-08-03T12:49:37.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:37.223+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:37.223863+0000) 2021-08-03T12:49:37.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:37.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:37.224864+0000) 2021-08-03T12:49:37.439 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:37.433+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:37.434283+0000) 2021-08-03T12:49:37.760 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:37.755+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:37.755717+0000) 2021-08-03T12:49:38.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:38.223+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:38.224026+0000) 2021-08-03T12:49:38.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:38.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:38.224965+0000) 2021-08-03T12:49:38.606 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:38.602+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:38.603448+0000) 2021-08-03T12:49:38.613 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:38.608+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:38.609001+0000) 2021-08-03T12:49:38.760 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:38.755+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:38.756486+0000) 2021-08-03T12:49:38.974 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:38.969+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:38.969999+0000) 2021-08-03T12:49:39.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:39.121+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:39.122149+0000) 2021-08-03T12:49:39.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:39.223+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:39.224149+0000) 2021-08-03T12:49:39.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:39.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:39.225084+0000) 2021-08-03T12:49:39.761 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:39.756+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:39.757116+0000) 2021-08-03T12:49:40.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:40.121+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:40.122311+0000) 2021-08-03T12:49:40.198 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:39.470+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3683 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:40.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:40.223+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:40.224297+0000) 2021-08-03T12:49:40.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:40.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:40.225199+0000) 2021-08-03T12:49:40.762 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:40.757+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:40.757905+0000) 2021-08-03T12:49:41.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:41.087+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:41.088545+0000) 2021-08-03T12:49:41.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:41.121+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:41.122443+0000) 2021-08-03T12:49:41.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:41.223+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:41.224426+0000) 2021-08-03T12:49:41.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:41.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:41.225311+0000) 2021-08-03T12:49:41.265 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:41.261+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:41.261938+0000) 2021-08-03T12:49:41.370 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:41.364+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:41.365108+0000) 2021-08-03T12:49:41.762 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:41.757+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:41.758489+0000) 2021-08-03T12:49:42.100 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:41.831+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8085 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:42.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:42.121+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:42.122584+0000) 2021-08-03T12:49:42.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:42.223+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:42.224561+0000) 2021-08-03T12:49:42.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:42.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:42.225417+0000) 2021-08-03T12:49:42.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:42.261+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:42.262656+0000) 2021-08-03T12:49:42.520 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:42.516+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:42.517330+0000) 2021-08-03T12:49:42.763 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:42.758+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:42.759048+0000) 2021-08-03T12:49:42.955 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:42.895+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8416 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:43.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:43.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:43.225532+0000) 2021-08-03T12:49:43.268 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:43.263+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:43.264402+0000) 2021-08-03T12:49:43.410 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:43.405+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:43.405785+0000) 2021-08-03T12:49:43.580 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:43.576+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:43.577325+0000) 2021-08-03T12:49:44.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:44.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:44.225686+0000) 2021-08-03T12:49:44.270 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:44.266+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:44.266904+0000) 2021-08-03T12:49:44.410 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:44.406+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:44.406835+0000) 2021-08-03T12:49:45.194 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:44.786+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3683 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:45.223 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:45.220+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:45.220825+0000) 2021-08-03T12:49:45.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:45.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:45.225796+0000) 2021-08-03T12:49:45.548 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:49:45.542+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:45.543191+0000) 2021-08-03T12:49:45.762 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:45.757+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:45.759001+0000) 2021-08-03T12:49:46.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:46.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:46.225937+0000) 2021-08-03T12:49:46.468 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:46.463+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:46.464040+0000) 2021-08-03T12:49:47.170 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:47.163+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:47.165439+0000) 2021-08-03T12:49:47.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:47.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:47.226072+0000) 2021-08-03T12:49:48.195 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:47.775+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:48.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:48.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:48.226202+0000) 2021-08-03T12:49:48.271 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:49:48.264+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:48.266475+0000) 2021-08-03T12:49:49.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:49.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:49.226347+0000) 2021-08-03T12:49:49.299 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:49.293+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:49.295087+0000) 2021-08-03T12:49:49.311 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:49.306+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:49.307667+0000) 2021-08-03T12:49:49.978 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:49.973+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:49.974966+0000) 2021-08-03T12:49:50.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:50.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:50.226488+0000) 2021-08-03T12:49:50.301 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:50.100+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3684 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:50.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:50.715+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:50.717224+0000) 2021-08-03T12:49:50.956 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:50.583+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8431 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:51.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:51.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:51.226646+0000) 2021-08-03T12:49:52.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:52.224+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:52.226800+0000) 2021-08-03T12:49:53.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:53.225+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:53.226955+0000) 2021-08-03T12:49:53.321 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:53.315+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:53.316523+0000) 2021-08-03T12:49:53.568 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:53.563+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:53.564636+0000) 2021-08-03T12:49:53.721 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:49:53.716+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:53.717307+0000) 2021-08-03T12:49:53.858 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:49:53.820+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:49:54.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:54.393+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:54.395244+0000) 2021-08-03T12:49:54.569 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:54.564+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:54.565453+0000) 2021-08-03T12:49:54.611 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:54.607+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:54.608867+0000) 2021-08-03T12:49:54.791 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:54.784+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:54.786707+0000) 2021-08-03T12:49:55.172 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:49:55.166+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:55.167340+0000) 2021-08-03T12:49:55.570 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:55.565+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:55.566057+0000) 2021-08-03T12:49:55.627 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:55.622+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:55.623599+0000) 2021-08-03T12:49:55.791 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:55.786+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:55.787494+0000) 2021-08-03T12:49:56.571 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:56.566+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:56.566872+0000) 2021-08-03T12:49:56.628 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:56.623+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:56.624381+0000) 2021-08-03T12:49:56.792 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:56.787+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:56.788150+0000) 2021-08-03T12:49:57.162 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:49:57.155+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:57.156387+0000) 2021-08-03T12:49:57.182 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:49:57.178+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:57.179610+0000) 2021-08-03T12:49:57.349 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:49:57.318+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3692 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:49:57.571 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:57.566+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:57.567424+0000) 2021-08-03T12:49:57.628 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:57.624+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:57.624984+0000) 2021-08-03T12:49:57.793 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:49:57.788+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:57.788812+0000) 2021-08-03T12:49:58.520 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:49:58.491+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8465 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:49:58.571 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:58.567+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:58.568011+0000) 2021-08-03T12:49:58.586 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:58.582+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:58.583468+0000) 2021-08-03T12:49:58.629 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:58.624+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:58.625575+0000) 2021-08-03T12:49:58.888 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:49:58.884+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:58.885611+0000) 2021-08-03T12:49:59.573 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:49:59.567+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:59.568998+0000) 2021-08-03T12:49:59.630 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:49:59.624+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:49:59.626392+0000) 2021-08-03T12:50:00.573 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:00.567+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:00.569673+0000) 2021-08-03T12:50:00.631 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:00.625+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:00.627002+0000) 2021-08-03T12:50:01.574 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:01.568+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:01.570548+0000) 2021-08-03T12:50:01.631 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:01.625+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:01.627795+0000) 2021-08-03T12:50:01.987 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:01.981+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:01.983043+0000) 2021-08-03T12:50:02.434 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:02.245+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:02.575 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:02.569+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:02.571222+0000) 2021-08-03T12:50:02.632 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:02.626+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:02.628371+0000) 2021-08-03T12:50:03.212 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:03.207+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:03.208982+0000) 2021-08-03T12:50:03.253 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:03.248+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:03.248958+0000) 2021-08-03T12:50:03.576 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:03.570+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:03.572042+0000) 2021-08-03T12:50:03.633 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:03.627+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:03.628952+0000) 2021-08-03T12:50:03.633 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:03.610+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8485 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:04.001 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:03.997+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:03.998050+0000) 2021-08-03T12:50:04.576 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:04.570+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:04.572767+0000) 2021-08-03T12:50:04.633 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:04.627+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:04.629546+0000) 2021-08-03T12:50:05.303 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:05.299+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:05.299932+0000) 2021-08-03T12:50:05.577 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:05.571+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:05.573392+0000) 2021-08-03T12:50:05.634 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:05.628+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:05.630165+0000) 2021-08-03T12:50:05.942 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:05.937+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:05.939652+0000) 2021-08-03T12:50:05.985 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:50:05.980+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:05.981081+0000) 2021-08-03T12:50:06.178 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:06.174+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:06.175665+0000) 2021-08-03T12:50:06.454 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:06.448+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:06.450299+0000) 2021-08-03T12:50:06.500 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:50:06.229+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3699 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:50:06.578 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:06.572+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:06.573991+0000) 2021-08-03T12:50:06.634 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:06.629+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:06.630908+0000) 2021-08-03T12:50:06.725 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:06.720+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:06.720829+0000) 2021-08-03T12:50:06.801 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:50:06.795+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:06.796705+0000) 2021-08-03T12:50:06.942 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:06.938+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:06.939802+0000) 2021-08-03T12:50:07.578 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:07.573+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:07.574578+0000) 2021-08-03T12:50:07.635 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:07.630+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:07.631561+0000) 2021-08-03T12:50:07.725 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:07.720+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:07.721575+0000) 2021-08-03T12:50:07.943 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:07.939+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:07.939974+0000) 2021-08-03T12:50:08.579 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:08.574+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:08.575182+0000) 2021-08-03T12:50:08.636 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:08.631+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:08.632441+0000) 2021-08-03T12:50:08.726 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:08.721+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:08.722173+0000) 2021-08-03T12:50:08.755 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:08.750+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:08.750949+0000) 2021-08-03T12:50:08.943 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:08.939+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:08.940137+0000) 2021-08-03T12:50:09.321 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:09.023+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:09.579 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:09.575+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:09.575800+0000) 2021-08-03T12:50:09.636 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:09.632+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:09.633046+0000) 2021-08-03T12:50:09.727 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:09.722+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:09.722776+0000) 2021-08-03T12:50:09.892 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:09.888+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:09.889235+0000) 2021-08-03T12:50:09.943 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:09.939+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:09.940302+0000) 2021-08-03T12:50:10.581 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:10.575+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:10.576756+0000) 2021-08-03T12:50:10.633 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:10.615+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8527 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:10.637 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:10.632+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:10.633631+0000) 2021-08-03T12:50:10.727 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:10.722+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:10.723412+0000) 2021-08-03T12:50:11.581 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:11.576+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:11.577365+0000) 2021-08-03T12:50:11.638 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:11.633+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:11.634606+0000) 2021-08-03T12:50:11.728 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:11.723+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:11.723970+0000) 2021-08-03T12:50:12.582 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:12.577+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:12.578432+0000) 2021-08-03T12:50:12.639 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:12.634+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:12.635223+0000) 2021-08-03T12:50:12.729 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:12.723+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:12.724638+0000) 2021-08-03T12:50:12.750 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:12.745+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:12.746857+0000) 2021-08-03T12:50:13.584 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:13.578+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:13.579013+0000) 2021-08-03T12:50:13.639 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:13.635+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:13.635853+0000) 2021-08-03T12:50:13.729 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:13.724+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:13.725235+0000) 2021-08-03T12:50:13.852 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:13.848+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:13.848828+0000) 2021-08-03T12:50:14.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:14.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:14.227310+0000) 2021-08-03T12:50:14.593 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:14.589+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:14.590510+0000) 2021-08-03T12:50:14.640 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:14.635+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:14.636465+0000) 2021-08-03T12:50:14.729 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:14.725+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:14.725854+0000) 2021-08-03T12:50:14.760 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:14.755+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:14.756304+0000) 2021-08-03T12:50:14.791 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:14.740+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:14.794 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:14.790+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:14.791149+0000) 2021-08-03T12:50:15.010 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:15.004+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:15.005084+0000) 2021-08-03T12:50:15.191 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:50:15.185+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:15.186230+0000) 2021-08-03T12:50:15.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:15.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:15.227442+0000) 2021-08-03T12:50:15.276 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:15.272+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:15.272878+0000) 2021-08-03T12:50:15.648 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:15.636+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:15.637465+0000) 2021-08-03T12:50:15.730 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:15.725+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:15.726642+0000) 2021-08-03T12:50:15.872 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:15.867+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:15.867924+0000) 2021-08-03T12:50:16.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:16.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:16.227619+0000) 2021-08-03T12:50:16.253 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:16.199+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8538 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:16.278 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:16.272+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:16.273678+0000) 2021-08-03T12:50:16.713 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:50:16.580+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3704 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:50:16.732 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:16.726+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:16.727331+0000) 2021-08-03T12:50:17.061 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:50:17.055+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:17.056358+0000) 2021-08-03T12:50:17.278 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:17.273+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:17.274491+0000) 2021-08-03T12:50:18.242 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:18.236+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:18.237070+0000) 2021-08-03T12:50:18.279 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:18.274+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:18.275454+0000) 2021-08-03T12:50:18.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:18.567+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:18.567883+0000) 2021-08-03T12:50:18.754 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:18.749+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:18.749819+0000) 2021-08-03T12:50:18.898 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:18.892+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:18.893509+0000) 2021-08-03T12:50:18.951 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:18.945+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:18.946545+0000) 2021-08-03T12:50:18.952 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:18.948+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:18.948880+0000) 2021-08-03T12:50:19.144 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:19.138+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:19.139789+0000) 2021-08-03T12:50:19.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:19.275+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:19.276044+0000) 2021-08-03T12:50:19.470 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:19.466+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:19.467593+0000) 2021-08-03T12:50:19.754 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:19.749+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:19.750519+0000) 2021-08-03T12:50:20.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:20.275+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:20.276657+0000) 2021-08-03T12:50:20.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:20.644+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:20.644856+0000) 2021-08-03T12:50:20.755 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:20.750+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:20.751065+0000) 2021-08-03T12:50:21.281 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:21.276+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:21.277689+0000) 2021-08-03T12:50:21.507 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:21.484+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:21.755 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:21.750+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:21.751624+0000) 2021-08-03T12:50:21.938 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:21.934+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:21.935253+0000) 2021-08-03T12:50:22.590 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:22.586+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:22.587215+0000) 2021-08-03T12:50:22.756 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:22.751+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:22.752395+0000) 2021-08-03T12:50:22.801 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:22.795+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:22.796362+0000) 2021-08-03T12:50:22.835 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:22.757+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8551 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:22.870 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:22.864+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:22.864797+0000) 2021-08-03T12:50:23.041 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:23.037+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:23.038455+0000) 2021-08-03T12:50:23.477 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:23.473+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:23.474129+0000) 2021-08-03T12:50:23.479 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:23.472+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:23.473256+0000) 2021-08-03T12:50:23.880 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:50:23.874+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:23.874794+0000) 2021-08-03T12:50:24.001 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:50:23.995+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:23.996349+0000) 2021-08-03T12:50:24.011 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:24.007+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:24.008606+0000) 2021-08-03T12:50:24.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:24.037+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:24.038599+0000) 2021-08-03T12:50:24.776 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:24.770+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:24.771742+0000) 2021-08-03T12:50:25.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:25.037+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:25.038765+0000) 2021-08-03T12:50:25.128 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:25.122+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:25.123527+0000) 2021-08-03T12:50:26.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:26.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:26.038896+0000) 2021-08-03T12:50:27.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:27.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:27.039060+0000) 2021-08-03T12:50:28.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:28.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:28.039216+0000) 2021-08-03T12:50:28.443 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:50:27.186+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:50:28.796 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:28.791+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:28.792181+0000) 2021-08-03T12:50:28.979 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:28.974+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:28.974978+0000) 2021-08-03T12:50:29.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:29.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:29.039375+0000) 2021-08-03T12:50:29.797 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:29.792+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:29.792916+0000) 2021-08-03T12:50:29.865 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:29.826+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:29.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:29.960+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:29.961268+0000) 2021-08-03T12:50:29.979 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:29.975+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:29.975956+0000) 2021-08-03T12:50:30.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:30.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:30.039502+0000) 2021-08-03T12:50:30.156 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:30.150+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:30.151483+0000) 2021-08-03T12:50:30.411 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:30.096+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8581 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:30.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:30.407+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:30.408112+0000) 2021-08-03T12:50:30.862 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:30.858+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:30.858954+0000) 2021-08-03T12:50:30.980 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:30.976+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:30.977007+0000) 2021-08-03T12:50:31.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:31.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:31.039618+0000) 2021-08-03T12:50:31.553 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:31.548+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:31.549640+0000) 2021-08-03T12:50:32.043 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:32.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:32.039779+0000) 2021-08-03T12:50:32.255 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:50:32.250+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:32.250840+0000) 2021-08-03T12:50:32.389 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:32.384+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:32.385448+0000) 2021-08-03T12:50:32.555 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:32.551+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:32.552343+0000) 2021-08-03T12:50:33.043 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:33.039+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:33.039926+0000) 2021-08-03T12:50:33.064 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:33.060+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:33.061135+0000) 2021-08-03T12:50:33.347 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:50:33.340+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:33.341640+0000) 2021-08-03T12:50:33.473 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:33.467+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:33.468344+0000) 2021-08-03T12:50:33.491 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:33.485+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:33.486688+0000) 2021-08-03T12:50:33.558 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:33.554+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:33.554973+0000) 2021-08-03T12:50:34.044 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:34.039+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:34.040094+0000) 2021-08-03T12:50:34.420 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:34.414+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:34.415076+0000) 2021-08-03T12:50:34.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:34.555+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:34.556057+0000) 2021-08-03T12:50:35.043 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:35.039+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:35.040241+0000) 2021-08-03T12:50:35.346 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:35.340+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:35.341199+0000) 2021-08-03T12:50:35.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:35.555+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:35.556201+0000) 2021-08-03T12:50:36.043 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:36.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:36.040365+0000) 2021-08-03T12:50:36.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:36.554+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:36.556466+0000) 2021-08-03T12:50:36.734 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:36.728+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:36.730336+0000) 2021-08-03T12:50:37.043 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:37.038+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:37.040490+0000) 2021-08-03T12:50:37.231 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:37.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:37.227976+0000) 2021-08-03T12:50:37.463 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:37.456+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8612 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:37.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:37.554+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:37.556619+0000) 2021-08-03T12:50:37.648 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:37.548+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:38.132 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:38.127+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:38.128077+0000) 2021-08-03T12:50:38.150 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:50:38.144+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:38.146467+0000) 2021-08-03T12:50:38.231 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:38.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:38.228116+0000) 2021-08-03T12:50:38.903 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:38.898+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:38.898956+0000) 2021-08-03T12:50:38.985 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:50:38.908+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:50:39.231 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:39.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:39.228276+0000) 2021-08-03T12:50:39.793 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:39.786+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:39.787784+0000) 2021-08-03T12:50:39.903 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:39.898+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:39.899544+0000) 2021-08-03T12:50:39.932 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:39.927+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:39.929161+0000) 2021-08-03T12:50:40.231 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:40.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:40.228433+0000) 2021-08-03T12:50:40.670 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:50:40.664+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:40.665624+0000) 2021-08-03T12:50:40.821 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:40.815+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:40.816619+0000) 2021-08-03T12:50:40.825 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:40.819+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:40.820652+0000) 2021-08-03T12:50:40.904 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:40.899+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:40.900349+0000) 2021-08-03T12:50:41.231 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:41.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:41.228583+0000) 2021-08-03T12:50:41.484 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:41.479+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:41.480384+0000) 2021-08-03T12:50:41.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:41.535+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:41.537545+0000) 2021-08-03T12:50:41.905 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:41.900+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:41.900980+0000) 2021-08-03T12:50:42.156 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:42.152+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:42.153235+0000) 2021-08-03T12:50:42.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:42.226+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:42.228726+0000) 2021-08-03T12:50:42.905 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:42.900+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:42.901604+0000) 2021-08-03T12:50:43.126 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:43.121+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:43.123222+0000) 2021-08-03T12:50:43.219 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:43.214+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:43.215973+0000) 2021-08-03T12:50:43.231 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:43.227+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:43.228858+0000) 2021-08-03T12:50:43.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:43.438+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:43.440032+0000) 2021-08-03T12:50:43.760 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:43.756+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:43.757035+0000) 2021-08-03T12:50:43.770 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:50:43.764+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:43.766215+0000) 2021-08-03T12:50:43.906 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:43.901+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:43.902595+0000) 2021-08-03T12:50:44.126 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:44.121+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:44.123387+0000) 2021-08-03T12:50:44.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:44.227+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:44.228989+0000) 2021-08-03T12:50:44.489 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:44.448+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8633 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:44.739 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:44.655+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8088 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:44.794 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:50:44.543+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:50:44.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:44.948+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:44.949178+0000) 2021-08-03T12:50:45.019 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:45.014+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:45.016683+0000) 2021-08-03T12:50:45.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:45.227+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:45.229120+0000) 2021-08-03T12:50:45.252 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:45.247+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:45.248095+0000) 2021-08-03T12:50:46.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:46.228+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:46.229256+0000) 2021-08-03T12:50:46.606 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:46.600+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:46.601133+0000) 2021-08-03T12:50:46.959 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:46.954+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:46.954792+0000) 2021-08-03T12:50:47.013 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:47.008+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:47.009162+0000) 2021-08-03T12:50:47.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:47.228+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:47.229421+0000) 2021-08-03T12:50:47.662 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:50:47.657+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:47.658109+0000) 2021-08-03T12:50:48.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:48.165+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:48.165877+0000) 2021-08-03T12:50:48.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:48.228+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:48.229558+0000) 2021-08-03T12:50:48.280 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:48.276+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:48.277736+0000) 2021-08-03T12:50:48.559 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:48.554+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:48.554824+0000) 2021-08-03T12:50:49.052 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:50:49.047+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:49.048320+0000) 2021-08-03T12:50:49.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:49.165+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:49.166064+0000) 2021-08-03T12:50:49.232 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:49.228+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:49.229716+0000) 2021-08-03T12:50:49.521 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:49.516+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:49.517220+0000) 2021-08-03T12:50:50.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:50.165+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:50.166209+0000) 2021-08-03T12:50:50.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:50.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:50.229827+0000) 2021-08-03T12:50:50.333 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:50:49.836+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:50:51.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:51.165+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:51.166357+0000) 2021-08-03T12:50:51.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:51.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:51.229983+0000) 2021-08-03T12:50:51.589 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:51.567+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8099 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:51.595 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:51.591+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:51.592808+0000) 2021-08-03T12:50:51.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:51.673+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:51.673957+0000) 2021-08-03T12:50:51.745 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:51.606+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8670 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:52.200 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:52.194+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:52.195284+0000) 2021-08-03T12:50:52.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:52.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:52.230098+0000) 2021-08-03T12:50:52.286 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:52.281+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:52.282398+0000) 2021-08-03T12:50:52.842 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:52.838+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:52.839062+0000) 2021-08-03T12:50:53.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:53.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:53.230213+0000) 2021-08-03T12:50:53.269 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:53.264+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:53.264961+0000) 2021-08-03T12:50:53.288 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:53.283+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:53.284409+0000) 2021-08-03T12:50:54.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:54.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:54.230363+0000) 2021-08-03T12:50:54.289 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:54.284+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:54.285603+0000) 2021-08-03T12:50:54.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:54.395+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:54.395844+0000) 2021-08-03T12:50:54.745 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:54.740+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:54.741393+0000) 2021-08-03T12:50:54.749 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:50:54.744+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:54.744892+0000) 2021-08-03T12:50:54.841 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:50:54.835+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:54.836615+0000) 2021-08-03T12:50:55.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:55.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:55.230511+0000) 2021-08-03T12:50:55.290 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:55.285+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:55.286233+0000) 2021-08-03T12:50:56.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:56.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:56.230630+0000) 2021-08-03T12:50:56.291 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:56.286+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:56.287021+0000) 2021-08-03T12:50:57.234 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:57.229+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:57.230791+0000) 2021-08-03T12:50:57.291 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:57.287+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:57.287885+0000) 2021-08-03T12:50:57.483 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:50:57.477+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:57.478270+0000) 2021-08-03T12:50:57.487 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:50:57.404+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:50:57.738 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:57.733+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:57.734086+0000) 2021-08-03T12:50:58.146 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:50:58.031+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8112 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:50:58.293 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:58.288+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:58.289131+0000) 2021-08-03T12:50:58.738 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:58.734+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:58.734798+0000) 2021-08-03T12:50:58.955 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:50:58.949+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:58.950418+0000) 2021-08-03T12:50:58.990 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:50:58.984+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:58.985144+0000) 2021-08-03T12:50:59.003 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:50:58.956+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8685 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:50:59.004 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:50:58.999+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:59.000671+0000) 2021-08-03T12:50:59.293 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:50:59.289+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:59.289968+0000) 2021-08-03T12:50:59.371 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:50:59.367+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:59.368267+0000) 2021-08-03T12:50:59.739 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:50:59.734+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:50:59.735404+0000) 2021-08-03T12:51:00.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:00.127+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:00.128064+0000) 2021-08-03T12:51:00.294 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:00.289+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:00.290625+0000) 2021-08-03T12:51:00.629 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:00.623+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:00.624333+0000) 2021-08-03T12:51:00.804 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:00.799+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:00.799926+0000) 2021-08-03T12:51:01.134 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:01.128+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:01.129457+0000) 2021-08-03T12:51:01.306 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:01.302+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:01.303161+0000) 2021-08-03T12:51:01.342 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:01.338+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:01.339005+0000) 2021-08-03T12:51:01.805 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:01.799+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:01.800537+0000) 2021-08-03T12:51:02.213 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:02.207+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:02.208024+0000) 2021-08-03T12:51:02.295 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:02.290+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:02.291739+0000) 2021-08-03T12:51:02.308 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:02.303+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:02.303741+0000) 2021-08-03T12:51:02.406 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:02.401+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:02.402124+0000) 2021-08-03T12:51:02.805 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:02.800+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:02.801137+0000) 2021-08-03T12:51:03.247 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:03.241+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:03.242037+0000) 2021-08-03T12:51:03.270 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:51:02.932+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:51:03.295 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:03.291+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:03.291884+0000) 2021-08-03T12:51:03.806 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:03.801+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:03.801951+0000) 2021-08-03T12:51:04.604 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:04.470+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8701 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:05.086 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:04.776+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8131 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:05.319 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:05.313+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:05.314696+0000) 2021-08-03T12:51:05.324 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:05.320+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:05.321001+0000) 2021-08-03T12:51:05.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:05.404+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:05.405012+0000) 2021-08-03T12:51:05.864 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:05.860+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:05.861495+0000) 2021-08-03T12:51:05.908 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:05.904+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:05.905147+0000) 2021-08-03T12:51:06.325 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:06.320+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:06.321707+0000) 2021-08-03T12:51:06.381 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:06.376+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:06.377744+0000) 2021-08-03T12:51:06.811 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:06.806+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:06.806839+0000) 2021-08-03T12:51:06.936 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:06.932+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:06.933051+0000) 2021-08-03T12:51:07.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:07.119+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.120131+0000) 2021-08-03T12:51:07.252 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:51:07.246+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.247789+0000) 2021-08-03T12:51:07.272 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:07.266+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.267734+0000) 2021-08-03T12:51:07.326 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:07.321+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.322314+0000) 2021-08-03T12:51:07.336 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:07.330+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.330877+0000) 2021-08-03T12:51:07.355 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:07.350+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.351390+0000) 2021-08-03T12:51:07.375 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:07.369+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.370644+0000) 2021-08-03T12:51:07.969 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:07.963+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:07.964517+0000) 2021-08-03T12:51:08.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:08.119+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:08.120287+0000) 2021-08-03T12:51:08.327 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:08.322+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:08.323131+0000) 2021-08-03T12:51:08.560 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:08.556+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:08.557032+0000) 2021-08-03T12:51:09.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:09.119+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:09.120428+0000) 2021-08-03T12:51:09.328 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:09.322+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:09.323710+0000) 2021-08-03T12:51:09.564 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:09.560+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:09.561313+0000) 2021-08-03T12:51:10.117 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:51:10.112+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:51:10.123 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:10.119+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:10.120593+0000) 2021-08-03T12:51:10.202 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:10.194+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8708 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:10.328 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:10.322+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:10.324346+0000) 2021-08-03T12:51:10.567 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:10.563+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:10.563808+0000) 2021-08-03T12:51:10.606 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:10.602+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:10.602898+0000) 2021-08-03T12:51:10.976 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:10.622+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8138 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:10.977 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:10.972+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:10.973446+0000) 2021-08-03T12:51:11.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:11.119+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:11.120742+0000) 2021-08-03T12:51:11.455 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:11.450+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:11.452420+0000) 2021-08-03T12:51:11.563 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:11.558+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:11.559077+0000) 2021-08-03T12:51:11.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:11.564+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:11.565557+0000) 2021-08-03T12:51:11.766 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:11.760+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:11.762011+0000) 2021-08-03T12:51:12.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:12.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:12.120868+0000) 2021-08-03T12:51:12.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:12.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:12.565831+0000) 2021-08-03T12:51:12.902 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:12.897+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:12.898713+0000) 2021-08-03T12:51:13.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:13.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:13.120970+0000) 2021-08-03T12:51:13.126 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:13.121+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:13.122270+0000) 2021-08-03T12:51:13.372 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:51:13.364+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:13.366376+0000) 2021-08-03T12:51:13.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:13.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:13.565977+0000) 2021-08-03T12:51:13.729 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:13.722+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:13.724246+0000) 2021-08-03T12:51:14.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:14.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:14.121088+0000) 2021-08-03T12:51:14.198 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:14.193+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:14.194180+0000) 2021-08-03T12:51:14.420 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:14.416+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:14.417277+0000) 2021-08-03T12:51:14.455 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:14.448+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:14.449954+0000) 2021-08-03T12:51:14.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:14.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:14.566198+0000) 2021-08-03T12:51:14.777 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:14.771+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:14.772718+0000) 2021-08-03T12:51:15.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:15.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:15.121210+0000) 2021-08-03T12:51:15.126 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:15.122+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:15.123732+0000) 2021-08-03T12:51:15.420 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:15.416+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:15.417433+0000) 2021-08-03T12:51:15.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:15.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:15.566332+0000) 2021-08-03T12:51:15.777 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:15.772+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:15.773419+0000) 2021-08-03T12:51:16.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:16.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:16.121368+0000) 2021-08-03T12:51:16.127 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:16.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:16.123853+0000) 2021-08-03T12:51:16.420 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:16.416+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:16.417591+0000) 2021-08-03T12:51:16.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:16.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:16.566521+0000) 2021-08-03T12:51:16.778 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:16.773+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:16.774032+0000) 2021-08-03T12:51:17.039 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:51:16.939+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:51:17.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:17.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:17.121498+0000) 2021-08-03T12:51:17.127 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:17.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:17.123971+0000) 2021-08-03T12:51:17.131 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:17.125+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:17.126716+0000) 2021-08-03T12:51:17.238 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:17.059+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8161 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:17.504 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:17.410+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8719 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:17.507 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:17.502+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:17.503801+0000) 2021-08-03T12:51:17.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:17.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:17.566650+0000) 2021-08-03T12:51:17.778 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:17.773+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:17.774598+0000) 2021-08-03T12:51:18.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:18.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:18.121642+0000) 2021-08-03T12:51:18.127 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:18.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:18.124080+0000) 2021-08-03T12:51:18.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:18.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:18.566857+0000) 2021-08-03T12:51:18.779 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:18.774+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:18.775333+0000) 2021-08-03T12:51:19.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:19.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:19.121791+0000) 2021-08-03T12:51:19.127 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:19.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:19.124201+0000) 2021-08-03T12:51:19.178 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:19.174+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:19.175547+0000) 2021-08-03T12:51:19.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:19.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:19.567001+0000) 2021-08-03T12:51:19.779 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:19.775+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:19.775922+0000) 2021-08-03T12:51:20.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:20.121+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:20.121936+0000) 2021-08-03T12:51:20.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:20.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:20.567306+0000) 2021-08-03T12:51:20.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:20.691+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:20.692012+0000) 2021-08-03T12:51:20.745 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:20.740+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:20.740751+0000) 2021-08-03T12:51:20.780 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:20.775+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:20.776489+0000) 2021-08-03T12:51:20.800 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:20.794+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:20.795518+0000) 2021-08-03T12:51:21.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:21.121+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:21.122035+0000) 2021-08-03T12:51:21.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:21.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:21.567415+0000) 2021-08-03T12:51:21.745 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:21.741+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:21.741724+0000) 2021-08-03T12:51:21.781 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:21.776+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:21.777392+0000) 2021-08-03T12:51:22.047 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:22.042+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.043054+0000) 2021-08-03T12:51:22.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:22.121+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.122169+0000) 2021-08-03T12:51:22.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:22.127+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.128568+0000) 2021-08-03T12:51:22.201 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:22.196+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.197061+0000) 2021-08-03T12:51:22.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:22.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.567680+0000) 2021-08-03T12:51:22.746 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:22.741+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.742337+0000) 2021-08-03T12:51:22.781 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:22.777+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.777894+0000) 2021-08-03T12:51:22.886 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:22.881+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:22.882623+0000) 2021-08-03T12:51:23.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:23.121+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:23.122322+0000) 2021-08-03T12:51:23.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:23.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:23.567812+0000) 2021-08-03T12:51:23.747 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:23.742+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:23.742896+0000) 2021-08-03T12:51:23.782 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:23.777+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:23.778443+0000) 2021-08-03T12:51:23.887 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:23.882+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:23.883230+0000) 2021-08-03T12:51:24.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:24.121+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:24.122453+0000) 2021-08-03T12:51:24.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:24.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:24.568026+0000) 2021-08-03T12:51:24.783 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:24.778+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:24.779048+0000) 2021-08-03T12:51:24.829 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:24.639+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8174 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:24.887 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:24.883+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:24.883825+0000) 2021-08-03T12:51:25.011 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:25.007+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:25.007872+0000) 2021-08-03T12:51:25.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:25.121+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:25.122560+0000) 2021-08-03T12:51:25.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:25.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:25.568182+0000) 2021-08-03T12:51:25.642 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:25.572+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8736 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:25.784 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:25.779+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:25.779721+0000) 2021-08-03T12:51:26.126 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:26.120+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:26.122663+0000) 2021-08-03T12:51:26.197 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:26.190+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:26.192603+0000) 2021-08-03T12:51:26.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:26.514+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:26.516005+0000) 2021-08-03T12:51:26.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:26.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:26.568381+0000) 2021-08-03T12:51:26.784 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:26.778+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:26.780497+0000) 2021-08-03T12:51:27.177 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:27.171+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:27.171989+0000) 2021-08-03T12:51:27.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:27.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:27.568520+0000) 2021-08-03T12:51:27.785 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:27.779+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:27.781580+0000) 2021-08-03T12:51:28.187 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:28.183+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:28.184548+0000) 2021-08-03T12:51:28.449 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:28.443+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:28.444885+0000) 2021-08-03T12:51:28.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:28.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:28.568743+0000) 2021-08-03T12:51:28.582 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:51:27.742+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:51:28.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:28.741+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:28.743241+0000) 2021-08-03T12:51:28.749 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:28.744+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:28.746035+0000) 2021-08-03T12:51:29.096 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:29.090+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:29.091426+0000) 2021-08-03T12:51:29.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:29.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:29.568878+0000) 2021-08-03T12:51:30.347 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:30.340+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:30.342716+0000) 2021-08-03T12:51:30.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:30.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:30.569061+0000) 2021-08-03T12:51:30.664 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:30.599+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8181 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:30.779 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:30.773+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:30.775260+0000) 2021-08-03T12:51:31.299 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:31.294+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:31.295195+0000) 2021-08-03T12:51:31.302 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:31.297+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:31.299415+0000) 2021-08-03T12:51:31.336 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:31.331+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:31.332735+0000) 2021-08-03T12:51:31.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:31.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:31.569197+0000) 2021-08-03T12:51:31.780 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:31.774+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:31.775955+0000) 2021-08-03T12:51:31.862 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:31.856+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:31.857786+0000) 2021-08-03T12:51:32.111 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:32.003+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8742 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:32.299 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:32.295+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:32.295884+0000) 2021-08-03T12:51:32.315 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:32.310+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:32.312717+0000) 2021-08-03T12:51:32.323 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:32.318+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:32.320186+0000) 2021-08-03T12:51:32.338 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:32.333+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:32.334616+0000) 2021-08-03T12:51:32.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:32.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:32.569376+0000) 2021-08-03T12:51:32.573 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:32.564+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:32.566529+0000) 2021-08-03T12:51:32.780 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:32.774+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:32.776504+0000) 2021-08-03T12:51:33.339 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:33.334+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:33.335190+0000) 2021-08-03T12:51:33.511 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:33.505+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:33.506746+0000) 2021-08-03T12:51:33.527 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:33.523+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:33.524451+0000) 2021-08-03T12:51:33.572 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:33.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:33.569507+0000) 2021-08-03T12:51:33.781 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:33.775+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:33.777433+0000) 2021-08-03T12:51:33.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:33.871+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:33.873083+0000) 2021-08-03T12:51:34.339 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:34.334+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.335762+0000) 2021-08-03T12:51:34.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:34.567+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.569737+0000) 2021-08-03T12:51:34.769 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:51:34.764+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.765398+0000) 2021-08-03T12:51:34.781 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:34.776+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.778204+0000) 2021-08-03T12:51:34.811 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:34.805+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.806920+0000) 2021-08-03T12:51:34.820 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:34.814+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.815603+0000) 2021-08-03T12:51:34.824 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:34.819+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.820478+0000) 2021-08-03T12:51:34.876 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:34.871+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:34.873259+0000) 2021-08-03T12:51:35.340 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:35.335+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:35.336319+0000) 2021-08-03T12:51:35.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:35.569+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:35.569888+0000) 2021-08-03T12:51:35.771 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:51:35.766+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:35.767309+0000) 2021-08-03T12:51:35.782 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:35.778+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:35.778747+0000) 2021-08-03T12:51:35.811 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:35.807+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:35.807887+0000) 2021-08-03T12:51:35.876 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:35.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:35.873406+0000) 2021-08-03T12:51:36.341 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:36.336+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:36.336913+0000) 2021-08-03T12:51:36.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:36.569+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:36.570156+0000) 2021-08-03T12:51:36.812 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:36.807+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:36.808496+0000) 2021-08-03T12:51:36.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:36.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:36.873553+0000) 2021-08-03T12:51:37.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:37.569+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:37.570305+0000) 2021-08-03T12:51:37.799 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:37.793+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:37.794721+0000) 2021-08-03T12:51:37.813 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:37.808+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:37.809117+0000) 2021-08-03T12:51:37.827 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:37.771+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8218 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:37.876 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:37.872+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:37.873709+0000) 2021-08-03T12:51:38.083 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:51:38.077+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:38.078302+0000) 2021-08-03T12:51:38.550 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:38.543+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8764 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:38.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:38.569+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:38.570529+0000) 2021-08-03T12:51:38.596 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:38.592+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:38.593445+0000) 2021-08-03T12:51:38.799 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:38.793+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:38.794587+0000) 2021-08-03T12:51:38.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:38.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:38.873846+0000) 2021-08-03T12:51:39.759 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:51:39.063+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3709 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:51:39.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:39.854+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:39.855626+0000) 2021-08-03T12:51:39.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:39.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:39.873935+0000) 2021-08-03T12:51:40.571 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:40.567+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:40.567855+0000) 2021-08-03T12:51:40.873 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:40.868+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:40.869289+0000) 2021-08-03T12:51:40.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:40.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:40.874043+0000) 2021-08-03T12:51:40.944 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:40.940+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:40.941342+0000) 2021-08-03T12:51:41.358 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:41.354+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:41.355557+0000) 2021-08-03T12:51:41.472 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:41.467+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:41.467953+0000) 2021-08-03T12:51:41.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:41.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:41.874193+0000) 2021-08-03T12:51:42.734 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:42.729+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:42.730743+0000) 2021-08-03T12:51:42.786 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:42.780+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:42.781672+0000) 2021-08-03T12:51:42.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:42.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:42.874335+0000) 2021-08-03T12:51:43.734 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:43.730+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:43.730900+0000) 2021-08-03T12:51:43.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:43.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:43.874485+0000) 2021-08-03T12:51:43.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:43.947+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:43.948707+0000) 2021-08-03T12:51:44.337 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:44.331+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:44.331772+0000) 2021-08-03T12:51:44.552 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:44.515+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8228 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:44.635 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:44.629+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:44.630742+0000) 2021-08-03T12:51:44.734 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:44.730+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:44.731020+0000) 2021-08-03T12:51:44.833 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:51:44.826+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:44.827249+0000) 2021-08-03T12:51:44.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:44.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:44.874660+0000) 2021-08-03T12:51:44.913 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:44.906+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:44.907718+0000) 2021-08-03T12:51:45.355 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:45.350+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:45.351071+0000) 2021-08-03T12:51:45.794 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:45.790+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:45.790863+0000) 2021-08-03T12:51:45.878 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:45.873+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:45.874799+0000) 2021-08-03T12:51:46.008 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:51:46.002+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:46.003659+0000) 2021-08-03T12:51:46.226 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:51:46.220+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:46.221108+0000) 2021-08-03T12:51:46.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:46.341+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:46.342513+0000) 2021-08-03T12:51:46.355 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:46.180+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8775 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:46.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:46.650+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:46.651006+0000) 2021-08-03T12:51:47.097 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:47.093+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:47.094085+0000) 2021-08-03T12:51:47.463 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:47.458+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:47.459710+0000) 2021-08-03T12:51:47.712 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:47.706+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:47.707698+0000) 2021-08-03T12:51:48.003 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:47.999+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:48.000025+0000) 2021-08-03T12:51:48.465 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:48.461+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:48.462233+0000) 2021-08-03T12:51:48.668 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:51:48.269+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:51:48.673 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:48.667+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:48.668578+0000) 2021-08-03T12:51:48.789 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:48.784+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:48.785221+0000) 2021-08-03T12:51:49.468 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:49.464+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:49.464863+0000) 2021-08-03T12:51:49.673 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:49.668+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:49.669343+0000) 2021-08-03T12:51:49.789 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:49.785+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:49.785909+0000) 2021-08-03T12:51:50.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:50.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:50.124559+0000) 2021-08-03T12:51:50.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:50.465+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:50.466398+0000) 2021-08-03T12:51:50.674 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:50.669+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:50.669951+0000) 2021-08-03T12:51:50.791 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:50.785+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:50.786481+0000) 2021-08-03T12:51:51.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:51.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:51.124712+0000) 2021-08-03T12:51:51.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:51.465+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:51.466519+0000) 2021-08-03T12:51:51.626 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:51:51.620+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:51.621589+0000) 2021-08-03T12:51:51.690 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:51.668+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8780 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:51.791 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:51.786+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:51.787212+0000) 2021-08-03T12:51:52.792 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:52.787+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:52.787765+0000) 2021-08-03T12:51:53.042 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:51:53.037+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:53.038859+0000) 2021-08-03T12:51:53.042 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:51:52.863+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8236 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:51:53.383 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:51:53.376+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:53.377206+0000) 2021-08-03T12:51:53.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:53.624+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:53.625236+0000) 2021-08-03T12:51:53.725 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:53.720+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:53.721675+0000) 2021-08-03T12:51:53.792 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:53.787+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:53.788581+0000) 2021-08-03T12:51:54.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:54.624+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:54.625352+0000) 2021-08-03T12:51:54.666 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:51:54.660+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:54.660915+0000) 2021-08-03T12:51:55.628 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:55.624+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:55.625510+0000) 2021-08-03T12:51:56.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:56.624+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:56.625661+0000) 2021-08-03T12:51:57.619 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:51:57.256+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8790 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:51:57.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:57.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:57.625790+0000) 2021-08-03T12:51:57.989 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:57.985+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:57.985943+0000) 2021-08-03T12:51:58.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:58.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:58.625949+0000) 2021-08-03T12:51:58.713 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:51:58.708+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:51:58.813 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:51:58.808+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:58.808988+0000) 2021-08-03T12:51:59.080 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:51:59.074+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:59.075562+0000) 2021-08-03T12:51:59.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:51:59.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:51:59.626092+0000) 2021-08-03T12:52:00.249 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:00.243+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:00.244769+0000) 2021-08-03T12:52:00.607 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:00.601+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:00.602255+0000) 2021-08-03T12:52:00.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:00.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:00.626241+0000) 2021-08-03T12:52:00.682 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:00.549+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8243 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:00.922 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:00.918+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:00.918958+0000) 2021-08-03T12:52:01.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:01.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:01.626350+0000) 2021-08-03T12:52:01.651 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:01.644+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:01.645572+0000) 2021-08-03T12:52:02.484 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:02.480+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:02.481581+0000) 2021-08-03T12:52:02.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:02.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:02.626462+0000) 2021-08-03T12:52:03.171 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:02.834+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8795 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:03.304 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:03.299+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:03.299930+0000) 2021-08-03T12:52:03.629 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:03.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:03.626595+0000) 2021-08-03T12:52:04.304 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:04.299+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:04.300631+0000) 2021-08-03T12:52:04.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:04.625+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:04.626708+0000) 2021-08-03T12:52:04.939 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:04.935+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:04.935880+0000) 2021-08-03T12:52:05.305 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:05.300+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:05.301203+0000) 2021-08-03T12:52:05.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:05.611+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:05.612271+0000) 2021-08-03T12:52:05.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:05.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:05.626847+0000) 2021-08-03T12:52:05.723 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:05.616+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8254 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:06.167 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:06.162+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:52:06.305 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:06.301+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:06.301795+0000) 2021-08-03T12:52:06.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:06.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:06.626997+0000) 2021-08-03T12:52:06.775 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:06.770+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:06.771152+0000) 2021-08-03T12:52:07.307 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:07.301+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:07.302609+0000) 2021-08-03T12:52:07.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:07.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:07.627154+0000) 2021-08-03T12:52:07.776 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:07.771+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:07.772170+0000) 2021-08-03T12:52:08.359 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:08.353+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:08.354733+0000) 2021-08-03T12:52:08.544 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:08.446+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8803 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:08.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:08.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:08.627264+0000) 2021-08-03T12:52:08.776 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:08.771+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:08.772781+0000) 2021-08-03T12:52:08.919 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:08.915+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:08.916042+0000) 2021-08-03T12:52:09.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:09.070+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:09.071390+0000) 2021-08-03T12:52:09.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:09.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:09.627392+0000) 2021-08-03T12:52:09.723 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:52:09.717+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:09.718587+0000) 2021-08-03T12:52:09.777 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:09.772+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:09.773363+0000) 2021-08-03T12:52:09.919 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:09.913+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:09.914642+0000) 2021-08-03T12:52:10.630 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:10.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:10.627528+0000) 2021-08-03T12:52:10.754 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:10.747+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:10.748109+0000) 2021-08-03T12:52:10.778 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:10.773+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:10.774106+0000) 2021-08-03T12:52:11.555 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:11.549+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:11.550080+0000) 2021-08-03T12:52:11.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:11.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:11.627641+0000) 2021-08-03T12:52:11.778 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:11.773+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:11.774690+0000) 2021-08-03T12:52:11.916 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:11.910+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8273 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:11.945 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:11.940+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:11.941774+0000) 2021-08-03T12:52:12.224 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:12.219+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:12.220139+0000) 2021-08-03T12:52:12.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:12.627+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:12.627807+0000) 2021-08-03T12:52:12.780 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:12.774+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:12.775715+0000) 2021-08-03T12:52:12.945 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:12.941+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:12.941948+0000) 2021-08-03T12:52:13.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:13.627+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:13.627947+0000) 2021-08-03T12:52:13.781 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:13.776+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:13.776976+0000) 2021-08-03T12:52:14.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:14.627+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:14.628071+0000) 2021-08-03T12:52:14.646 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:14.640+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:14.641382+0000) 2021-08-03T12:52:14.753 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:14.748+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:14.749095+0000) 2021-08-03T12:52:14.782 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:14.777+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:14.777876+0000) 2021-08-03T12:52:14.796 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:14.792+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:14.792773+0000) 2021-08-03T12:52:15.437 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:15.433+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:15.434404+0000) 2021-08-03T12:52:15.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:15.627+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:15.628212+0000) 2021-08-03T12:52:15.667 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:15.550+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8807 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:15.753 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:15.749+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:15.749802+0000) 2021-08-03T12:52:15.782 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:15.777+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:15.778773+0000) 2021-08-03T12:52:15.797 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:15.793+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:15.793876+0000) 2021-08-03T12:52:16.617 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:16.611+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:16.612446+0000) 2021-08-03T12:52:16.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:16.626+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:16.628348+0000) 2021-08-03T12:52:16.755 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:16.749+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:16.751287+0000) 2021-08-03T12:52:16.785 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:16.778+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:16.779735+0000) 2021-08-03T12:52:16.798 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:16.792+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:16.794450+0000) 2021-08-03T12:52:16.855 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:16.796+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:52:16.927 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:16.922+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:16.924407+0000) 2021-08-03T12:52:17.110 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:17.105+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:17.106877+0000) 2021-08-03T12:52:17.443 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:17.438+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:17.439847+0000) 2021-08-03T12:52:17.484 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:17.476+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:17.477194+0000) 2021-08-03T12:52:17.757 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:17.751+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:17.753709+0000) 2021-08-03T12:52:17.799 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:17.793+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:17.795024+0000) 2021-08-03T12:52:18.110 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:18.105+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:18.107022+0000) 2021-08-03T12:52:18.224 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:18.088+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8286 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:18.429 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:52:18.423+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:18.425126+0000) 2021-08-03T12:52:18.758 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:18.752+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:18.754302+0000) 2021-08-03T12:52:19.160 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:19.155+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:19.157013+0000) 2021-08-03T12:52:21.340 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:21.332+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:21.334559+0000) 2021-08-03T12:52:21.393 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:21.386+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:21.388141+0000) 2021-08-03T12:52:21.764 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:21.757+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:21.759169+0000) 2021-08-03T12:52:21.767 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:21.762+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:21.764635+0000) 2021-08-03T12:52:22.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:22.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:22.125068+0000) 2021-08-03T12:52:22.206 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:22.201+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:22.203135+0000) 2021-08-03T12:52:22.213 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:22.206+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:22.208251+0000) 2021-08-03T12:52:22.237 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:22.230+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:22.231972+0000) 2021-08-03T12:52:22.445 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:22.326+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8839 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:22.464 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:22.458+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:22.460263+0000) 2021-08-03T12:52:23.035 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:23.028+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:23.030259+0000) 2021-08-03T12:52:23.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:23.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:23.125199+0000) 2021-08-03T12:52:24.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:24.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:24.125309+0000) 2021-08-03T12:52:24.381 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:24.376+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:24.378713+0000) 2021-08-03T12:52:25.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:25.123+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:25.125445+0000) 2021-08-03T12:52:25.382 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:25.378+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:25.378837+0000) 2021-08-03T12:52:25.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:25.695+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:25.695905+0000) 2021-08-03T12:52:25.725 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:25.514+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:52:25.982 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:25.959+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8305 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:26.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:26.124+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:26.125593+0000) 2021-08-03T12:52:27.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:27.124+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:27.125714+0000) 2021-08-03T12:52:27.335 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:27.331+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:27.331950+0000) 2021-08-03T12:52:28.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:28.125+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:28.125834+0000) 2021-08-03T12:52:29.050 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:29.043+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:29.044454+0000) 2021-08-03T12:52:29.051 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:29.046+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:29.046965+0000) 2021-08-03T12:52:29.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:29.125+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:29.125943+0000) 2021-08-03T12:52:29.130 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:29.124+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:29.125372+0000) 2021-08-03T12:52:29.532 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:29.528+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:29.528864+0000) 2021-08-03T12:52:29.567 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:29.526+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8839 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:29.583 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:29.579+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:29.580228+0000) 2021-08-03T12:52:29.879 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:52:29.873+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:29.874120+0000) 2021-08-03T12:52:30.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:30.125+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:30.126095+0000) 2021-08-03T12:52:30.420 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:30.409+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:30.410013+0000) 2021-08-03T12:52:31.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:31.125+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:31.126237+0000) 2021-08-03T12:52:32.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:32.125+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:32.126387+0000) 2021-08-03T12:52:33.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:33.125+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:33.126549+0000) 2021-08-03T12:52:33.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:33.128+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:33.129259+0000) 2021-08-03T12:52:33.204 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:33.200+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:33.201474+0000) 2021-08-03T12:52:34.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:34.125+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:34.126684+0000) 2021-08-03T12:52:34.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:34.128+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:34.129377+0000) 2021-08-03T12:52:34.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:34.294+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:34.294857+0000) 2021-08-03T12:52:34.451 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:33.614+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:52:34.636 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:34.630+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8315 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:34.707 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:34.702+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:34.703050+0000) 2021-08-03T12:52:35.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:35.294+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:35.295000+0000) 2021-08-03T12:52:35.444 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:35.221+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8839 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:36.239 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:36.234+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:36.235151+0000) 2021-08-03T12:52:36.786 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:36.782+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:36.782832+0000) 2021-08-03T12:52:37.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:37.057+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:37.057983+0000) 2021-08-03T12:52:37.690 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:37.686+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:37.687326+0000) 2021-08-03T12:52:37.788 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:37.783+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:37.783876+0000) 2021-08-03T12:52:38.221 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:38.217+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:38.218358+0000) 2021-08-03T12:52:38.229 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:38.223+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:38.224661+0000) 2021-08-03T12:52:38.312 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:38.307+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:38.307879+0000) 2021-08-03T12:52:38.708 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:38.702+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:38.703128+0000) 2021-08-03T12:52:38.788 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:38.783+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:38.784468+0000) 2021-08-03T12:52:38.812 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:38.808+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:38.809749+0000) 2021-08-03T12:52:38.824 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:38.819+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:38.820682+0000) 2021-08-03T12:52:39.312 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:39.307+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:39.308642+0000) 2021-08-03T12:52:39.789 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:39.784+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:39.785062+0000) 2021-08-03T12:52:39.825 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:39.820+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:39.821254+0000) 2021-08-03T12:52:39.878 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:39.405+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:52:40.247 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:52:40.241+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:40.242327+0000) 2021-08-03T12:52:40.313 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:40.308+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:40.309454+0000) 2021-08-03T12:52:40.387 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:40.382+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:40.382965+0000) 2021-08-03T12:52:40.535 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:40.529+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:40.530507+0000) 2021-08-03T12:52:40.789 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:40.785+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:40.785844+0000) 2021-08-03T12:52:40.826 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:40.821+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:40.821873+0000) 2021-08-03T12:52:41.232 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:41.009+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8342 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:41.314 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:41.309+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:41.310003+0000) 2021-08-03T12:52:41.791 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:41.785+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:41.786457+0000) 2021-08-03T12:52:42.121 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:41.710+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8841 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:42.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:42.470+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:42.470995+0000) 2021-08-03T12:52:43.352 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:43.346+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:43.347797+0000) 2021-08-03T12:52:43.423 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:43.419+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:43.420447+0000) 2021-08-03T12:52:44.466 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:44.461+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:44.462333+0000) 2021-08-03T12:52:44.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:44.747+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:44.748161+0000) 2021-08-03T12:52:44.792 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:44.786+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:44.787359+0000) 2021-08-03T12:52:44.796 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:44.790+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:44.790853+0000) 2021-08-03T12:52:44.828 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:44.822+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:44.823550+0000) 2021-08-03T12:52:45.199 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:45.193+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:45.194212+0000) 2021-08-03T12:52:45.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:45.253+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:45.254775+0000) 2021-08-03T12:52:45.467 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:45.462+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:45.463236+0000) 2021-08-03T12:52:45.773 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:45.769+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:45.770517+0000) 2021-08-03T12:52:45.958 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:45.951+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:45.952364+0000) 2021-08-03T12:52:46.037 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:46.032+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:46.033762+0000) 2021-08-03T12:52:46.166 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:52:46.160+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:46.161732+0000) 2021-08-03T12:52:46.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:46.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:46.254910+0000) 2021-08-03T12:52:46.325 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:46.189+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:52:47.184 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:47.178+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:47.179022+0000) 2021-08-03T12:52:47.526 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:47.501+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8357 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:47.712 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:47.706+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:47.707588+0000) 2021-08-03T12:52:47.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:47.811+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:47.811929+0000) 2021-08-03T12:52:47.922 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:47.881+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8841 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:48.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:48.863+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:48.864306+0000) 2021-08-03T12:52:48.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:48.896+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:48.897020+0000) 2021-08-03T12:52:49.105 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:49.099+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:49.099982+0000) 2021-08-03T12:52:49.763 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:49.757+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:49.758481+0000) 2021-08-03T12:52:49.966 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:49.961+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:49.961861+0000) 2021-08-03T12:52:50.312 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:50.306+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:50.307433+0000) 2021-08-03T12:52:50.763 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:50.758+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:50.759480+0000) 2021-08-03T12:52:50.837 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:50.833+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:50.834289+0000) 2021-08-03T12:52:50.839 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:50.835+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:50.836772+0000) 2021-08-03T12:52:50.953 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:50.947+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:50.948485+0000) 2021-08-03T12:52:51.397 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:51.392+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:52:51.485 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:51.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:51.482872+0000) 2021-08-03T12:52:51.764 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:51.759+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:51.760145+0000) 2021-08-03T12:52:52.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:52.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:52.482978+0000) 2021-08-03T12:52:52.764 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:52.760+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:52.760728+0000) 2021-08-03T12:52:53.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:53.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:53.483115+0000) 2021-08-03T12:52:53.765 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:53.761+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:53.761755+0000) 2021-08-03T12:52:54.016 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:54.010+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8850 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:52:54.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:54.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:54.483243+0000) 2021-08-03T12:52:54.766 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:54.761+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:54.762334+0000) 2021-08-03T12:52:54.981 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:54.977+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:54.978137+0000) 2021-08-03T12:52:55.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:55.126+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:55.127105+0000) 2021-08-03T12:52:55.313 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:55.309+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:55.310234+0000) 2021-08-03T12:52:55.364 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:52:55.359+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:55.359952+0000) 2021-08-03T12:52:55.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:55.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:55.483377+0000) 2021-08-03T12:52:55.766 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:55.762+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:55.762905+0000) 2021-08-03T12:52:56.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:56.126+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:56.127253+0000) 2021-08-03T12:52:56.681 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:52:56.658+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8389 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:52:56.767 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:56.762+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:56.763644+0000) 2021-08-03T12:52:57.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:57.126+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:57.127363+0000) 2021-08-03T12:52:57.356 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:52:57.351+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:57.352175+0000) 2021-08-03T12:52:57.383 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:57.379+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:57.380338+0000) 2021-08-03T12:52:57.768 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:57.763+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:57.764321+0000) 2021-08-03T12:52:58.315 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:52:58.309+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:58.310420+0000) 2021-08-03T12:52:58.316 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:52:58.310+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:58.311126+0000) 2021-08-03T12:52:58.349 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:52:58.343+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:58.344291+0000) 2021-08-03T12:52:58.368 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:52:58.362+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:58.362844+0000) 2021-08-03T12:52:58.769 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:58.764+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:58.765056+0000) 2021-08-03T12:52:58.931 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:52:58.927+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:58.928029+0000) 2021-08-03T12:52:58.969 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:52:58.965+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:58.966151+0000) 2021-08-03T12:52:59.343 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:52:59.337+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:59.338550+0000) 2021-08-03T12:52:59.769 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:52:59.764+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:52:59.765654+0000) 2021-08-03T12:52:59.925 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:52:59.752+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:00.002 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:52:59.889+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8855 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:00.030 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:00.024+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:00.025104+0000) 2021-08-03T12:53:00.084 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:00.080+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:00.081463+0000) 2021-08-03T12:53:00.361 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:00.355+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:00.356730+0000) 2021-08-03T12:53:00.770 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:00.765+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:00.766343+0000) 2021-08-03T12:53:00.908 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:00.904+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:00.904911+0000) 2021-08-03T12:53:01.391 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:01.386+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:01.387082+0000) 2021-08-03T12:53:01.764 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:01.760+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:01.761424+0000) 2021-08-03T12:53:01.771 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:01.766+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:01.766952+0000) 2021-08-03T12:53:02.062 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:02.057+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:02.057755+0000) 2021-08-03T12:53:02.420 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:02.155+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8394 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:02.771 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:02.766+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:02.767605+0000) 2021-08-03T12:53:02.795 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:02.789+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:02.790646+0000) 2021-08-03T12:53:03.772 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:03.767+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:03.768214+0000) 2021-08-03T12:53:03.795 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:03.790+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:03.791363+0000) 2021-08-03T12:53:03.910 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:03.905+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:03.906101+0000) 2021-08-03T12:53:04.455 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:04.448+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:04.449655+0000) 2021-08-03T12:53:04.491 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:04.487+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:04.487891+0000) 2021-08-03T12:53:04.693 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:04.689+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:04.690472+0000) 2021-08-03T12:53:04.773 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:04.768+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:04.768982+0000) 2021-08-03T12:53:04.795 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:04.791+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:04.791913+0000) 2021-08-03T12:53:05.511 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:05.507+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:05.508517+0000) 2021-08-03T12:53:05.696 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:05.691+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:05.693032+0000) 2021-08-03T12:53:05.773 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:05.767+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:05.769639+0000) 2021-08-03T12:53:05.796 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:05.791+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:05.792526+0000) 2021-08-03T12:53:06.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:06.693+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:06.695593+0000) 2021-08-03T12:53:06.774 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:06.768+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:06.770247+0000) 2021-08-03T12:53:06.796 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:06.790+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:06.792329+0000) 2021-08-03T12:53:06.797 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:06.792+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:06.793659+0000) 2021-08-03T12:53:07.555 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:07.482+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8861 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:07.774 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:07.769+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:07.770862+0000) 2021-08-03T12:53:07.796 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:07.791+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:07.793007+0000) 2021-08-03T12:53:08.361 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:08.353+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:08.355230+0000) 2021-08-03T12:53:08.435 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:08.430+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:08.432474+0000) 2021-08-03T12:53:08.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:08.503+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:08.505729+0000) 2021-08-03T12:53:08.775 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:08.769+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:08.771455+0000) 2021-08-03T12:53:08.797 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:08.791+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:08.793560+0000) 2021-08-03T12:53:09.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:09.504+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:09.505849+0000) 2021-08-03T12:53:09.570 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:09.564+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:09.565160+0000) 2021-08-03T12:53:09.612 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:09.606+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:09.607025+0000) 2021-08-03T12:53:09.776 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:09.770+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:09.772042+0000) 2021-08-03T12:53:09.792 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:09.582+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8399 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:09.798 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:09.792+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:09.794085+0000) 2021-08-03T12:53:10.107 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:10.102+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:10.104043+0000) 2021-08-03T12:53:10.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:10.123+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:10.125752+0000) 2021-08-03T12:53:10.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:10.504+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:10.506012+0000) 2021-08-03T12:53:10.776 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:10.771+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:10.772761+0000) 2021-08-03T12:53:10.798 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:10.793+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:10.794807+0000) 2021-08-03T12:53:11.192 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:11.186+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:11.187799+0000) 2021-08-03T12:53:11.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:11.504+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:11.506127+0000) 2021-08-03T12:53:11.674 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:11.669+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:11.671257+0000) 2021-08-03T12:53:11.777 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:11.771+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:11.773320+0000) 2021-08-03T12:53:11.799 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:11.793+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:11.795335+0000) 2021-08-03T12:53:11.832 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:11.826+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:11.827851+0000) 2021-08-03T12:53:12.108 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:12.101+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:12.103475+0000) 2021-08-03T12:53:12.149 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:53:11.869+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:12.320 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:12.315+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:12.315946+0000) 2021-08-03T12:53:12.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:12.504+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:12.506268+0000) 2021-08-03T12:53:12.582 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:12.577+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:12.578406+0000) 2021-08-03T12:53:12.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:12.669+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:12.671423+0000) 2021-08-03T12:53:12.778 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:12.772+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:12.774065+0000) 2021-08-03T12:53:12.834 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:12.826+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:12.828609+0000) 2021-08-03T12:53:13.054 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:13.048+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:13.050758+0000) 2021-08-03T12:53:13.322 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:13.316+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:13.317446+0000) 2021-08-03T12:53:13.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:13.504+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:13.506407+0000) 2021-08-03T12:53:13.674 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:13.669+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:13.671541+0000) 2021-08-03T12:53:13.778 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:13.773+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:13.774747+0000) 2021-08-03T12:53:13.833 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:13.827+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:13.829175+0000) 2021-08-03T12:53:13.946 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:13.942+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:13.943032+0000) 2021-08-03T12:53:14.323 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:14.318+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:14.319010+0000) 2021-08-03T12:53:14.500 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:14.492+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:14.493892+0000) 2021-08-03T12:53:14.509 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:14.504+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:14.506553+0000) 2021-08-03T12:53:14.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:14.669+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:14.671680+0000) 2021-08-03T12:53:14.779 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:14.774+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:14.775363+0000) 2021-08-03T12:53:14.833 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:14.829+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:14.829866+0000) 2021-08-03T12:53:14.946 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:14.942+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:14.943184+0000) 2021-08-03T12:53:15.104 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:15.097+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8893 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:15.780 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:15.775+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:15.775979+0000) 2021-08-03T12:53:15.946 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:15.942+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:15.943310+0000) 2021-08-03T12:53:15.954 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:15.948+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:15.949505+0000) 2021-08-03T12:53:16.397 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:16.229+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8407 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:16.473 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:16.468+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:16.469330+0000) 2021-08-03T12:53:16.578 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:16.572+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:16.573739+0000) 2021-08-03T12:53:16.596 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:16.592+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:16.592939+0000) 2021-08-03T12:53:16.785 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:16.775+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:16.776581+0000) 2021-08-03T12:53:16.946 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:16.942+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:16.943466+0000) 2021-08-03T12:53:17.286 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:17.281+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:17.282769+0000) 2021-08-03T12:53:17.456 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:17.451+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:17.451884+0000) 2021-08-03T12:53:17.607 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:17.601+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:17.601992+0000) 2021-08-03T12:53:17.781 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:17.776+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:17.777510+0000) 2021-08-03T12:53:18.099 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:18.095+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:18.096084+0000) 2021-08-03T12:53:18.100 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:18.094+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:18.095322+0000) 2021-08-03T12:53:18.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:18.126+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:18.127733+0000) 2021-08-03T12:53:18.485 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:18.481+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:18.482243+0000) 2021-08-03T12:53:18.782 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:18.777+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:18.778098+0000) 2021-08-03T12:53:19.095 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:19.089+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:19.090365+0000) 2021-08-03T12:53:19.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:19.127+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:19.127884+0000) 2021-08-03T12:53:19.782 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:19.777+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:19.778662+0000) 2021-08-03T12:53:19.985 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:19.979+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:19.980623+0000) 2021-08-03T12:53:20.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:20.127+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:20.128024+0000) 2021-08-03T12:53:20.153 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:20.147+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:20.148492+0000) 2021-08-03T12:53:20.326 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:20.321+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:20.322788+0000) 2021-08-03T12:53:20.961 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:53:20.547+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:21.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:21.127+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:21.128130+0000) 2021-08-03T12:53:22.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:22.127+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:22.128257+0000) 2021-08-03T12:53:23.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:23.127+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:23.128418+0000) 2021-08-03T12:53:23.457 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:23.404+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8422 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:24.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:24.154+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:24.155400+0000) 2021-08-03T12:53:24.463 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:24.129+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8919 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:24.644 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:24.638+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:24.639216+0000) 2021-08-03T12:53:25.022 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:25.017+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:25.018217+0000) 2021-08-03T12:53:25.104 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:25.099+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:25.099985+0000) 2021-08-03T12:53:25.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:25.631+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:25.631935+0000) 2021-08-03T12:53:25.828 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:25.821+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:25.822672+0000) 2021-08-03T12:53:26.003 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:25.997+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:25.998795+0000) 2021-08-03T12:53:26.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:26.631+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:26.632069+0000) 2021-08-03T12:53:27.054 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:27.049+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:27.050146+0000) 2021-08-03T12:53:27.188 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:27.182+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:27.183119+0000) 2021-08-03T12:53:27.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:27.631+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:27.632220+0000) 2021-08-03T12:53:27.808 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:27.803+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:27.804192+0000) 2021-08-03T12:53:28.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:28.136+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:28.137598+0000) 2021-08-03T12:53:28.287 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:28.283+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:28.283950+0000) 2021-08-03T12:53:28.362 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:28.357+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:28.357977+0000) 2021-08-03T12:53:28.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:28.631+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:28.632368+0000) 2021-08-03T12:53:28.809 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:28.804+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:28.805512+0000) 2021-08-03T12:53:29.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:29.165+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.166138+0000) 2021-08-03T12:53:29.362 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:29.358+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.358821+0000) 2021-08-03T12:53:29.414 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:29.409+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.410734+0000) 2021-08-03T12:53:29.490 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:29.484+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.485202+0000) 2021-08-03T12:53:29.589 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:29.581+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8428 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:29.635 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:29.631+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.632502+0000) 2021-08-03T12:53:29.687 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:29.681+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.681771+0000) 2021-08-03T12:53:29.810 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:29.805+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.806702+0000) 2021-08-03T12:53:29.846 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:29.840+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:29.841446+0000) 2021-08-03T12:53:29.908 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:29.765+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8919 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:30.211 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:30.205+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:30.206333+0000) 2021-08-03T12:53:30.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:30.424+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:30.424999+0000) 2021-08-03T12:53:30.437 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:30.431+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:30.431854+0000) 2021-08-03T12:53:30.444 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:53:30.048+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:30.811 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:30.806+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:30.807157+0000) 2021-08-03T12:53:30.824 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:30.820+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:30.821348+0000) 2021-08-03T12:53:30.862 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:30.858+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:30.859558+0000) 2021-08-03T12:53:31.715 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:31.709+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:31.710589+0000) 2021-08-03T12:53:31.811 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:31.806+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:31.807760+0000) 2021-08-03T12:53:31.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:31.858+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:31.859700+0000) 2021-08-03T12:53:31.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:31.958+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:31.959274+0000) 2021-08-03T12:53:32.347 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:32.340+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:32.342287+0000) 2021-08-03T12:53:32.812 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:32.806+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:32.808344+0000) 2021-08-03T12:53:32.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:32.859+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:32.859854+0000) 2021-08-03T12:53:33.728 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:33.722+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:33.722971+0000) 2021-08-03T12:53:33.813 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:33.807+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:33.809446+0000) 2021-08-03T12:53:33.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:33.859+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:33.859998+0000) 2021-08-03T12:53:34.814 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:34.808+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:34.810342+0000) 2021-08-03T12:53:34.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:34.859+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:34.860146+0000) 2021-08-03T12:53:35.815 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:35.809+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:35.810918+0000) 2021-08-03T12:53:35.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:35.859+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:35.860297+0000) 2021-08-03T12:53:36.689 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:36.556+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8948 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:36.692 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:36.688+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:36.688839+0000) 2021-08-03T12:53:36.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:36.859+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:36.860439+0000) 2021-08-03T12:53:37.353 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:37.345+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:37.347642+0000) 2021-08-03T12:53:37.851 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:37.508+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8438 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:37.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:37.859+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:37.860559+0000) 2021-08-03T12:53:37.998 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:37.990+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:37.991317+0000) 2021-08-03T12:53:38.318 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:38.313+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:38.315298+0000) 2021-08-03T12:53:38.581 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:38.575+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:38.576663+0000) 2021-08-03T12:53:38.634 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:53:38.600+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:38.657 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:38.653+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:38.653810+0000) 2021-08-03T12:53:39.078 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:39.071+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:39.073556+0000) 2021-08-03T12:53:39.082 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:39.075+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:39.077039+0000) 2021-08-03T12:53:39.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:39.392+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:39.393480+0000) 2021-08-03T12:53:40.761 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:40.757+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:40.757850+0000) 2021-08-03T12:53:40.865 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:40.859+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:40.860770+0000) 2021-08-03T12:53:40.899 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:40.895+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:40.896480+0000) 2021-08-03T12:53:41.465 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:41.459+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:41.460400+0000) 2021-08-03T12:53:41.761 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:41.757+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:41.757989+0000) 2021-08-03T12:53:42.015 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:42.009+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:42.010582+0000) 2021-08-03T12:53:42.424 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:42.417+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:42.418122+0000) 2021-08-03T12:53:42.761 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:42.757+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:42.758101+0000) 2021-08-03T12:53:42.805 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:42.800+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:42.801287+0000) 2021-08-03T12:53:43.015 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:43.010+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:43.011445+0000) 2021-08-03T12:53:43.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:43.263+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:43.264618+0000) 2021-08-03T12:53:43.333 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:43.308+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8958 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:43.961 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:43.956+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:43.957152+0000) 2021-08-03T12:53:44.016 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:44.011+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:44.012096+0000) 2021-08-03T12:53:44.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:44.128+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:44.128853+0000) 2021-08-03T12:53:44.894 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:44.421+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8464 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:45.114 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:45.110+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:45.111639+0000) 2021-08-03T12:53:45.116 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:53:45.032+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:45.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:45.128+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:45.128977+0000) 2021-08-03T12:53:45.515 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:45.511+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:45.512277+0000) 2021-08-03T12:53:45.729 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:45.724+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:45.725037+0000) 2021-08-03T12:53:46.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:46.128+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:46.129088+0000) 2021-08-03T12:53:46.373 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:46.369+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:46.370211+0000) 2021-08-03T12:53:46.450 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:46.445+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:46.445960+0000) 2021-08-03T12:53:47.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:47.128+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:47.129242+0000) 2021-08-03T12:53:47.480 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:47.475+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:47.476087+0000) 2021-08-03T12:53:47.938 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:47.933+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:47.934353+0000) 2021-08-03T12:53:47.947 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:47.942+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:47.943795+0000) 2021-08-03T12:53:48.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:48.128+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:48.129397+0000) 2021-08-03T12:53:48.146 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:48.141+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:48.142055+0000) 2021-08-03T12:53:48.481 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:48.476+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:48.476825+0000) 2021-08-03T12:53:48.592 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:48.588+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:48.589454+0000) 2021-08-03T12:53:48.680 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:48.675+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:48.675808+0000) 2021-08-03T12:53:48.708 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:48.702+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:48.703702+0000) 2021-08-03T12:53:48.947 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:48.943+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:48.943947+0000) 2021-08-03T12:53:49.093 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:48.999+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8964 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:49.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:49.128+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:49.129576+0000) 2021-08-03T12:53:49.481 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:49.476+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:49.477453+0000) 2021-08-03T12:53:49.947 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:49.943+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:49.944072+0000) 2021-08-03T12:53:50.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:50.128+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:50.129729+0000) 2021-08-03T12:53:50.482 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:50.477+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:50.478064+0000) 2021-08-03T12:53:50.708 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:50.704+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:50.705058+0000) 2021-08-03T12:53:50.947 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:50.943+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:50.944205+0000) 2021-08-03T12:53:51.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:51.129+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:51.129883+0000) 2021-08-03T12:53:51.332 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:51.328+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:51.329108+0000) 2021-08-03T12:53:51.367 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:51.361+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:51.362715+0000) 2021-08-03T12:53:51.483 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:51.478+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:51.478875+0000) 2021-08-03T12:53:51.947 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:51.943+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:51.944350+0000) 2021-08-03T12:53:52.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:52.129+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.129986+0000) 2021-08-03T12:53:52.180 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:52.174+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.175797+0000) 2021-08-03T12:53:52.483 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:52.479+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.479816+0000) 2021-08-03T12:53:52.667 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:53:52.441+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:52.684 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:52.678+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.679172+0000) 2021-08-03T12:53:52.687 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:53:52.681+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.681990+0000) 2021-08-03T12:53:52.726 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:53:52.719+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.720344+0000) 2021-08-03T12:53:52.822 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:52.817+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.818115+0000) 2021-08-03T12:53:52.947 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:52.943+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:52.944506+0000) 2021-08-03T12:53:53.034 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:53.028+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:53.029658+0000) 2021-08-03T12:53:53.036 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:52.793+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8474 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:53.886 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:53.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:53.883463+0000) 2021-08-03T12:53:54.051 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:54.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:54.048415+0000) 2021-08-03T12:53:54.289 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:54.285+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:54.286526+0000) 2021-08-03T12:53:54.453 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:53:54.447+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:54.448154+0000) 2021-08-03T12:53:54.657 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:54.652+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:54.653853+0000) 2021-08-03T12:53:54.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:54.695+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:54.695932+0000) 2021-08-03T12:53:54.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:54.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:54.883618+0000) 2021-08-03T12:53:55.051 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:55.046+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:55.048592+0000) 2021-08-03T12:53:55.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:55.881+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:55.883760+0000) 2021-08-03T12:53:56.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:56.046+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:56.048725+0000) 2021-08-03T12:53:56.558 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:53:56.543+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 8968 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:53:56.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:56.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:56.883858+0000) 2021-08-03T12:53:57.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:57.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:57.048874+0000) 2021-08-03T12:53:57.537 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:53:57.531+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:57.532043+0000) 2021-08-03T12:53:57.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:57.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:57.883987+0000) 2021-08-03T12:53:58.050 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:53:58.043+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.044745+0000) 2021-08-03T12:53:58.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:58.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.048986+0000) 2021-08-03T12:53:58.052 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:58.045+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.047238+0000) 2021-08-03T12:53:58.115 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:53:58.109+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.111219+0000) 2021-08-03T12:53:58.244 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:53:58.167+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8481 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:53:58.353 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:58.347+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.349600+0000) 2021-08-03T12:53:58.536 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:53:58.532+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.533293+0000) 2021-08-03T12:53:58.725 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:53:58.718+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.719535+0000) 2021-08-03T12:53:58.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:58.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.884115+0000) 2021-08-03T12:53:58.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:58.905+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:58.907097+0000) 2021-08-03T12:53:59.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:59.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:59.049089+0000) 2021-08-03T12:53:59.354 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:53:59.348+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:59.350472+0000) 2021-08-03T12:53:59.469 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:53:59.406+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:53:59.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:53:59.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:53:59.884250+0000) 2021-08-03T12:54:00.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:00.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:00.049209+0000) 2021-08-03T12:54:00.355 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:00.349+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:00.351275+0000) 2021-08-03T12:54:00.371 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:00.366+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:00.367582+0000) 2021-08-03T12:54:00.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:00.853+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:00.855233+0000) 2021-08-03T12:54:00.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:00.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:00.884363+0000) 2021-08-03T12:54:01.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:01.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:01.049333+0000) 2021-08-03T12:54:01.355 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:01.350+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:01.351882+0000) 2021-08-03T12:54:01.372 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:01.367+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:01.368549+0000) 2021-08-03T12:54:01.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:01.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:01.884476+0000) 2021-08-03T12:54:02.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:02.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:02.049495+0000) 2021-08-03T12:54:02.356 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:02.351+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:02.352810+0000) 2021-08-03T12:54:02.373 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:02.368+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:02.369345+0000) 2021-08-03T12:54:02.888 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:02.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:02.884657+0000) 2021-08-03T12:54:03.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:03.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:03.049651+0000) 2021-08-03T12:54:03.357 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:03.351+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:03.353386+0000) 2021-08-03T12:54:03.374 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:03.369+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:03.369988+0000) 2021-08-03T12:54:03.888 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:03.882+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:03.884785+0000) 2021-08-03T12:54:04.053 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:04.047+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:04.049784+0000) 2021-08-03T12:54:04.191 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:54:04.184+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:04.185993+0000) 2021-08-03T12:54:04.358 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:04.353+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:04.354486+0000) 2021-08-03T12:54:04.375 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:04.369+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:04.370604+0000) 2021-08-03T12:54:04.888 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:04.884+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:04.884959+0000) 2021-08-03T12:54:05.053 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:05.049+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:05.049913+0000) 2021-08-03T12:54:05.359 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:05.354+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:05.355188+0000) 2021-08-03T12:54:05.375 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:05.370+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:05.371265+0000) 2021-08-03T12:54:05.569 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:05.548+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8492 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:05.888 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:05.884+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:05.885076+0000) 2021-08-03T12:54:05.905 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:05.899+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:05.900791+0000) 2021-08-03T12:54:06.063 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:05.892+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9006 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:06.723 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:54:06.717+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:06.718547+0000) 2021-08-03T12:54:07.167 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:07.162+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:07.162823+0000) 2021-08-03T12:54:07.403 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:54:07.396+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:54:07.548 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:54:07.544+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:07.545216+0000) 2021-08-03T12:54:07.717 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:07.712+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:07.713719+0000) 2021-08-03T12:54:07.785 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:07.780+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:07.780773+0000) 2021-08-03T12:54:08.236 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:08.232+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:08.233016+0000) 2021-08-03T12:54:08.327 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:08.322+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:08.323075+0000) 2021-08-03T12:54:08.470 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:08.465+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:08.465949+0000) 2021-08-03T12:54:08.804 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:08.800+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:08.800966+0000) 2021-08-03T12:54:09.407 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:54:09.401+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:09.401916+0000) 2021-08-03T12:54:10.509 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:54:10.503+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:10.504164+0000) 2021-08-03T12:54:13.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:13.129+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:13.130391+0000) 2021-08-03T12:54:13.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:13.634+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:13.635491+0000) 2021-08-03T12:54:13.812 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:13.807+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:13.807801+0000) 2021-08-03T12:54:13.930 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:13.424+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8511 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:14.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:14.129+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:14.130504+0000) 2021-08-03T12:54:14.185 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:13.925+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9033 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:14.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:14.634+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:14.635648+0000) 2021-08-03T12:54:14.812 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:14.807+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:14.808511+0000) 2021-08-03T12:54:15.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:15.129+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:15.130630+0000) 2021-08-03T12:54:15.217 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:54:15.211+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:15.212486+0000) 2021-08-03T12:54:15.486 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:54:15.206+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:54:15.813 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:15.808+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:15.809300+0000) 2021-08-03T12:54:16.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:16.129+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:16.130761+0000) 2021-08-03T12:54:16.236 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:16.231+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:16.232234+0000) 2021-08-03T12:54:16.239 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:16.235+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:16.236367+0000) 2021-08-03T12:54:16.814 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:16.809+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:16.810033+0000) 2021-08-03T12:54:17.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:17.130+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:17.130882+0000) 2021-08-03T12:54:17.815 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:17.810+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:17.810895+0000) 2021-08-03T12:54:18.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:18.130+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:18.131037+0000) 2021-08-03T12:54:18.797 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:18.790+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:18.790872+0000) 2021-08-03T12:54:18.798 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:18.791+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:18.792221+0000) 2021-08-03T12:54:18.816 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:18.810+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:18.811693+0000) 2021-08-03T12:54:18.841 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:18.764+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8522 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:19.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:19.130+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:19.131146+0000) 2021-08-03T12:54:19.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:19.146+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:19.147471+0000) 2021-08-03T12:54:19.698 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:19.693+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:19.694719+0000) 2021-08-03T12:54:19.816 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:19.811+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:19.812503+0000) 2021-08-03T12:54:20.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:20.130+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:20.131277+0000) 2021-08-03T12:54:20.699 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:20.694+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:20.695345+0000) 2021-08-03T12:54:20.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:20.717+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:20.718456+0000) 2021-08-03T12:54:20.817 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:20.812+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:20.813305+0000) 2021-08-03T12:54:21.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:21.130+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:21.131412+0000) 2021-08-03T12:54:21.711 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:21.705+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9042 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:21.817 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:21.813+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:21.813902+0000) 2021-08-03T12:54:22.111 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:54:22.106+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:54:22.134 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:22.130+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:22.131556+0000) 2021-08-03T12:54:22.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:22.385+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:22.386023+0000) 2021-08-03T12:54:22.818 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:22.813+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:22.814710+0000) 2021-08-03T12:54:23.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:23.130+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:23.131696+0000) 2021-08-03T12:54:23.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:23.385+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:23.386138+0000) 2021-08-03T12:54:23.492 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:23.486+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:23.487071+0000) 2021-08-03T12:54:23.819 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:23.814+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:23.815262+0000) 2021-08-03T12:54:24.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:24.385+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:24.386256+0000) 2021-08-03T12:54:24.492 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:24.487+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:24.488385+0000) 2021-08-03T12:54:24.820 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:24.815+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:24.815953+0000) 2021-08-03T12:54:25.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:25.385+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:25.386387+0000) 2021-08-03T12:54:25.493 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:25.488+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:25.489505+0000) 2021-08-03T12:54:25.820 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:25.815+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:25.816476+0000) 2021-08-03T12:54:26.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:26.385+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:26.386525+0000) 2021-08-03T12:54:26.494 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:26.489+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:26.490417+0000) 2021-08-03T12:54:26.512 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:25.606+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8542 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:26.821 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:26.816+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:26.817017+0000) 2021-08-03T12:54:27.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:27.385+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:27.386632+0000) 2021-08-03T12:54:27.496 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:27.490+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:27.491594+0000) 2021-08-03T12:54:27.822 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:27.817+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:27.818045+0000) 2021-08-03T12:54:28.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:28.385+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:28.386750+0000) 2021-08-03T12:54:28.497 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:28.491+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:28.492732+0000) 2021-08-03T12:54:28.822 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:28.817+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:28.818621+0000) 2021-08-03T12:54:29.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:29.386+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:29.386901+0000) 2021-08-03T12:54:29.498 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:29.493+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:29.493705+0000) 2021-08-03T12:54:29.823 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:29.818+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:29.819167+0000) 2021-08-03T12:54:30.388 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:30.058+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9050 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:30.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:30.386+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:30.387081+0000) 2021-08-03T12:54:30.500 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:30.494+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:30.495452+0000) 2021-08-03T12:54:30.824 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:30.819+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:30.819970+0000) 2021-08-03T12:54:31.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:31.386+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:31.387201+0000) 2021-08-03T12:54:31.501 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:31.495+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:31.496675+0000) 2021-08-03T12:54:31.824 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:31.820+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:31.820761+0000) 2021-08-03T12:54:32.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:32.386+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:32.387336+0000) 2021-08-03T12:54:32.501 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:32.496+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:32.497604+0000) 2021-08-03T12:54:32.825 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:32.820+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:32.821712+0000) 2021-08-03T12:54:33.254 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:54:32.807+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3711 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:54:33.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:33.386+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:33.387512+0000) 2021-08-03T12:54:33.502 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:33.497+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:33.498787+0000) 2021-08-03T12:54:33.826 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:33.821+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:33.822323+0000) 2021-08-03T12:54:34.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:34.386+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:34.387682+0000) 2021-08-03T12:54:34.503 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:34.499+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:34.499835+0000) 2021-08-03T12:54:34.676 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:34.671+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8584 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:34.827 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:34.822+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:34.823051+0000) 2021-08-03T12:54:35.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:35.387+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:35.387834+0000) 2021-08-03T12:54:35.504 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:35.499+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:35.500784+0000) 2021-08-03T12:54:35.827 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:35.822+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:35.823642+0000) 2021-08-03T12:54:36.386 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:36.377+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:36.378103+0000) 2021-08-03T12:54:36.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:36.387+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:36.387951+0000) 2021-08-03T12:54:36.506 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:36.500+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:36.501752+0000) 2021-08-03T12:54:36.828 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:36.823+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:36.824215+0000) 2021-08-03T12:54:37.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:37.387+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:37.388075+0000) 2021-08-03T12:54:37.506 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:37.501+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:37.502698+0000) 2021-08-03T12:54:37.674 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:37.668+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:37.669486+0000) 2021-08-03T12:54:37.829 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:37.824+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:37.824802+0000) 2021-08-03T12:54:38.016 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:37.734+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9059 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:38.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:38.387+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:38.388188+0000) 2021-08-03T12:54:38.507 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:38.502+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:38.503612+0000) 2021-08-03T12:54:38.829 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:38.824+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:38.825428+0000) 2021-08-03T12:54:39.153 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:39.148+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:39.148954+0000) 2021-08-03T12:54:39.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:39.387+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:39.388344+0000) 2021-08-03T12:54:39.510 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:39.504+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:39.505072+0000) 2021-08-03T12:54:39.527 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:39.523+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:39.523828+0000) 2021-08-03T12:54:39.831 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:39.825+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:39.826264+0000) 2021-08-03T12:54:40.517 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:40.511+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:40.511866+0000) 2021-08-03T12:54:40.831 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:40.826+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:40.827027+0000) 2021-08-03T12:54:41.340 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:54:41.334+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:41.335058+0000) 2021-08-03T12:54:41.832 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:41.827+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:41.827755+0000) 2021-08-03T12:54:41.832 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:54:41.681+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:54:42.337 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:41.911+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8591 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:42.833 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:42.827+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:42.828602+0000) 2021-08-03T12:54:42.851 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:54:42.846+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:42.846874+0000) 2021-08-03T12:54:43.833 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:43.828+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:43.829392+0000) 2021-08-03T12:54:45.179 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:45.137+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:45.340 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:45.334+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:45.336300+0000) 2021-08-03T12:54:45.848 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:54:45.840+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:45.842221+0000) 2021-08-03T12:54:46.332 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:46.324+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:46.326564+0000) 2021-08-03T12:54:46.341 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:46.335+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:46.337263+0000) 2021-08-03T12:54:47.342 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:47.335+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:47.337796+0000) 2021-08-03T12:54:47.990 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:47.984+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:47.985749+0000) 2021-08-03T12:54:48.279 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:54:48.274+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:48.276353+0000) 2021-08-03T12:54:48.342 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:48.336+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:48.338396+0000) 2021-08-03T12:54:48.640 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:48.634+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:48.635819+0000) 2021-08-03T12:54:49.343 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:49.337+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:49.339275+0000) 2021-08-03T12:54:49.720 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:49.680+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8607 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:50.344 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:50.338+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:50.339907+0000) 2021-08-03T12:54:50.560 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:54:50.325+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:54:51.344 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:54:51.338+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:51.340571+0000) 2021-08-03T12:54:52.728 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:52.722+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:52.723920+0000) 2021-08-03T12:54:52.902 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:52.312+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:53.729 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:53.723+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:53.724450+0000) 2021-08-03T12:54:53.948 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:54:53.944+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:53.945427+0000) 2021-08-03T12:54:54.730 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:54.724+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:54.725719+0000) 2021-08-03T12:54:55.043 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:55.038+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:55.039572+0000) 2021-08-03T12:54:55.481 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:55.476+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:55.477753+0000) 2021-08-03T12:54:55.730 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:55.726+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:55.726759+0000) 2021-08-03T12:54:56.044 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:56.039+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:56.040233+0000) 2021-08-03T12:54:56.208 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:56.204+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:56.204938+0000) 2021-08-03T12:54:56.405 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:56.401+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:56.402241+0000) 2021-08-03T12:54:56.468 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:56.464+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:56.465539+0000) 2021-08-03T12:54:56.693 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:54:56.597+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8614 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:54:56.731 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:56.726+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:56.727601+0000) 2021-08-03T12:54:56.957 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:54:56.952+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:56.953448+0000) 2021-08-03T12:54:57.046 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:57.040+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:57.040873+0000) 2021-08-03T12:54:57.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:57.263+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:57.263945+0000) 2021-08-03T12:54:57.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:57.464+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:57.465665+0000) 2021-08-03T12:54:57.732 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:57.727+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:57.728458+0000) 2021-08-03T12:54:58.046 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:58.041+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:58.041858+0000) 2021-08-03T12:54:58.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:58.263+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:58.264087+0000) 2021-08-03T12:54:58.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:58.464+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:58.465799+0000) 2021-08-03T12:54:58.538 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:54:58.465+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:54:58.733 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:58.728+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:58.729303+0000) 2021-08-03T12:54:59.046 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:54:59.041+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:59.042551+0000) 2021-08-03T12:54:59.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:59.263+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:59.264237+0000) 2021-08-03T12:54:59.444 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:54:59.438+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:59.439333+0000) 2021-08-03T12:54:59.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:54:59.465+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:59.465955+0000) 2021-08-03T12:54:59.642 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:54:59.363+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:54:59.734 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:54:59.729+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:59.730204+0000) 2021-08-03T12:54:59.739 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:54:59.733+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:54:59.734531+0000) 2021-08-03T12:55:00.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:00.263+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:00.264381+0000) 2021-08-03T12:55:00.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:00.465+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:00.466092+0000) 2021-08-03T12:55:00.513 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:00.508+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:00.509482+0000) 2021-08-03T12:55:00.655 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:55:00.650+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:00.650782+0000) 2021-08-03T12:55:01.268 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:01.263+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:01.264531+0000) 2021-08-03T12:55:01.469 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:01.465+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:01.466209+0000) 2021-08-03T12:55:01.486 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:01.481+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:01.481844+0000) 2021-08-03T12:55:01.514 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:01.509+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:01.510150+0000) 2021-08-03T12:55:01.521 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:01.515+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:01.516298+0000) 2021-08-03T12:55:02.183 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:02.178+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:02.179135+0000) 2021-08-03T12:55:02.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:02.263+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:02.264659+0000) 2021-08-03T12:55:02.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:02.465+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:02.466350+0000) 2021-08-03T12:55:02.516 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:02.510+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:02.511368+0000) 2021-08-03T12:55:02.894 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:02.886+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8614 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:03.516 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:03.511+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:03.511938+0000) 2021-08-03T12:55:04.517 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:04.511+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:04.512549+0000) 2021-08-03T12:55:05.224 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:55:05.218+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:05.218990+0000) 2021-08-03T12:55:05.517 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:05.512+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:05.513304+0000) 2021-08-03T12:55:05.939 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:05.935+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:05.936410+0000) 2021-08-03T12:55:06.059 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:05.559+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:06.217 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:06.213+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:06.214147+0000) 2021-08-03T12:55:06.685 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:06.680+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:06.681698+0000) 2021-08-03T12:55:06.949 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:06.945+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:06.945938+0000) 2021-08-03T12:55:07.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:07.698+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:07.698881+0000) 2021-08-03T12:55:07.728 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:55:07.436+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:55:08.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:08.701+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:08.702343+0000) 2021-08-03T12:55:09.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:09.705+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:09.705908+0000) 2021-08-03T12:55:10.320 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:10.316+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:10.317314+0000) 2021-08-03T12:55:10.465 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:10.412+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8616 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:10.493 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:10.486+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:10.487717+0000) 2021-08-03T12:55:10.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:10.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:10.707799+0000) 2021-08-03T12:55:11.623 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:11.617+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:11.618751+0000) 2021-08-03T12:55:11.708 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:11.639+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:11.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:11.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:11.707919+0000) 2021-08-03T12:55:12.491 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:12.486+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:12.487668+0000) 2021-08-03T12:55:12.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:12.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:12.708157+0000) 2021-08-03T12:55:13.393 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:13.389+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:13.390043+0000) 2021-08-03T12:55:13.683 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:13.679+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:13.680096+0000) 2021-08-03T12:55:13.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:13.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:13.708286+0000) 2021-08-03T12:55:13.957 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:55:13.950+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:13.951679+0000) 2021-08-03T12:55:14.393 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:14.389+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:14.390180+0000) 2021-08-03T12:55:14.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:14.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:14.708507+0000) 2021-08-03T12:55:14.737 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:14.731+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:14.731975+0000) 2021-08-03T12:55:15.393 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:15.389+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:15.390312+0000) 2021-08-03T12:55:15.566 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:55:14.894+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:55:15.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:15.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:15.708646+0000) 2021-08-03T12:55:15.848 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:15.843+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:15.844755+0000) 2021-08-03T12:55:16.288 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:16.283+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:16.283825+0000) 2021-08-03T12:55:16.393 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:16.389+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:16.390464+0000) 2021-08-03T12:55:16.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:16.708+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:16.708860+0000) 2021-08-03T12:55:17.394 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:17.389+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:17.390580+0000) 2021-08-03T12:55:17.643 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:55:17.636+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:17.637791+0000) 2021-08-03T12:55:17.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:17.708+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:17.708979+0000) 2021-08-03T12:55:18.374 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:18.351+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8625 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:18.394 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:18.389+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:18.390715+0000) 2021-08-03T12:55:19.920 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:19.914+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:20.388 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:55:20.383+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:20.383967+0000) 2021-08-03T12:55:20.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:20.608+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:20.609344+0000) 2021-08-03T12:55:20.989 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:20.984+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:20.985797+0000) 2021-08-03T12:55:21.636 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:21.632+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:21.633000+0000) 2021-08-03T12:55:22.965 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:22.960+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:22.961015+0000) 2021-08-03T12:55:23.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:23.465+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:23.466706+0000) 2021-08-03T12:55:23.864 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:23.857+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:23.858641+0000) 2021-08-03T12:55:23.949 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:23.944+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:23.945701+0000) 2021-08-03T12:55:23.965 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:23.960+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:23.961713+0000) 2021-08-03T12:55:24.002 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:23.997+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:23.998172+0000) 2021-08-03T12:55:24.148 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:24.143+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:24.144714+0000) 2021-08-03T12:55:24.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:24.466+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:24.466851+0000) 2021-08-03T12:55:24.949 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:24.944+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:24.945856+0000) 2021-08-03T12:55:25.148 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:25.144+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:25.144843+0000) 2021-08-03T12:55:25.964 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:25.654+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8644 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:26.059 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:26.053+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:26.054082+0000) 2021-08-03T12:55:26.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:26.564+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:26.564937+0000) 2021-08-03T12:55:26.696 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:55:26.587+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:55:26.805 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:55:26.799+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:26.799747+0000) 2021-08-03T12:55:27.059 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:26.991+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9067 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:27.741 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:27.737+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:27.737992+0000) 2021-08-03T12:55:27.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:27.856+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:27.857448+0000) 2021-08-03T12:55:28.922 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:28.910+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:28.910850+0000) 2021-08-03T12:55:29.166 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:29.159+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:29.159747+0000) 2021-08-03T12:55:29.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:29.515+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:29.516044+0000) 2021-08-03T12:55:30.443 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:30.437+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:30.438353+0000) 2021-08-03T12:55:30.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:30.515+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:30.516251+0000) 2021-08-03T12:55:30.599 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:30.593+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:30.594278+0000) 2021-08-03T12:55:31.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:31.515+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:31.516402+0000) 2021-08-03T12:55:31.660 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:31.653+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8690 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:31.820 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:55:31.813+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:31.814616+0000) 2021-08-03T12:55:32.477 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:32.472+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:32.474134+0000) 2021-08-03T12:55:32.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:32.514+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:32.516537+0000) 2021-08-03T12:55:32.542 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:32.538+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:32.539022+0000) 2021-08-03T12:55:32.988 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:32.981+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:32.982612+0000) 2021-08-03T12:55:33.492 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:55:33.485+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:33.487176+0000) 2021-08-03T12:55:33.520 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:33.514+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:33.516728+0000) 2021-08-03T12:55:33.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:33.773+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:33.775771+0000) 2021-08-03T12:55:34.466 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:34.460+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:34.462051+0000) 2021-08-03T12:55:34.520 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:34.515+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:34.516907+0000) 2021-08-03T12:55:34.555 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:34.543+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9079 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:36.082 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:36.076+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:36.078765+0000) 2021-08-03T12:55:36.393 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:55:36.386+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:36.387467+0000) 2021-08-03T12:55:36.634 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:55:36.369+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:55:36.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:36.757+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:36.759624+0000) 2021-08-03T12:55:36.871 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:36.866+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:36.868090+0000) 2021-08-03T12:55:37.889 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:55:37.883+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:37.884484+0000) 2021-08-03T12:55:38.306 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:38.300+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:38.301957+0000) 2021-08-03T12:55:38.625 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:38.413+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8702 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:38.712 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:38.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:38.709449+0000) 2021-08-03T12:55:39.315 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:39.311+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:39.312526+0000) 2021-08-03T12:55:39.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:39.710+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:39.712043+0000) 2021-08-03T12:55:40.487 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:40.478+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:40.479517+0000) 2021-08-03T12:55:40.561 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:40.555+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:40.557445+0000) 2021-08-03T12:55:40.639 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:55:40.633+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:40.634191+0000) 2021-08-03T12:55:40.641 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:40.636+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:40.638305+0000) 2021-08-03T12:55:40.718 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:40.712+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:40.714591+0000) 2021-08-03T12:55:41.076 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:41.070+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:41.071574+0000) 2021-08-03T12:55:41.272 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:55:41.267+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:41.267745+0000) 2021-08-03T12:55:41.276 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:41.271+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:41.271875+0000) 2021-08-03T12:55:41.369 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:40.876+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9079 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:41.713 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:41.707+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:41.708613+0000) 2021-08-03T12:55:41.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:41.715+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:41.716027+0000) 2021-08-03T12:55:42.098 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:42.094+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:42.095192+0000) 2021-08-03T12:55:42.190 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:42.184+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:42.185075+0000) 2021-08-03T12:55:42.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:42.715+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:42.716248+0000) 2021-08-03T12:55:43.442 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:43.438+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:43.439046+0000) 2021-08-03T12:55:43.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:43.715+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:43.716401+0000) 2021-08-03T12:55:44.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:44.715+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:44.716645+0000) 2021-08-03T12:55:45.194 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:55:45.187+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:45.188399+0000) 2021-08-03T12:55:45.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:45.466+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:45.467141+0000) 2021-08-03T12:55:45.645 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:45.641+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:45.642264+0000) 2021-08-03T12:55:45.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:45.715+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:45.716779+0000) 2021-08-03T12:55:45.845 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:45.841+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:45.842020+0000) 2021-08-03T12:55:45.854 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:45.849+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:45.850424+0000) 2021-08-03T12:55:46.321 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:55:46.266+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:55:46.645 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:46.641+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:46.642419+0000) 2021-08-03T12:55:46.720 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:46.716+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:46.716998+0000) 2021-08-03T12:55:46.724 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:46.381+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8710 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:46.855 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:46.850+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:46.851393+0000) 2021-08-03T12:55:47.136 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:47.132+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:47.133415+0000) 2021-08-03T12:55:47.151 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:47.145+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:47.146652+0000) 2021-08-03T12:55:47.196 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:47.121+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9079 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:47.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:47.641+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:47.642558+0000) 2021-08-03T12:55:47.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:47.719+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:47.720530+0000) 2021-08-03T12:55:47.856 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:47.851+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:47.852041+0000) 2021-08-03T12:55:48.351 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:48.346+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:48.346780+0000) 2021-08-03T12:55:48.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:48.641+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:48.642726+0000) 2021-08-03T12:55:48.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:48.722+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:48.723124+0000) 2021-08-03T12:55:48.856 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:48.851+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:48.852650+0000) 2021-08-03T12:55:48.923 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:55:48.917+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:48.918270+0000) 2021-08-03T12:55:49.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:49.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:49.642868+0000) 2021-08-03T12:55:49.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:49.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:49.724589+0000) 2021-08-03T12:55:49.843 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:49.838+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:49.839061+0000) 2021-08-03T12:55:49.857 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:49.852+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:49.853432+0000) 2021-08-03T12:55:50.058 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:50.053+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:50.054632+0000) 2021-08-03T12:55:50.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:50.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:50.643024+0000) 2021-08-03T12:55:50.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:50.723+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:50.724778+0000) 2021-08-03T12:55:50.858 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:50.853+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:50.854036+0000) 2021-08-03T12:55:51.061 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:51.054+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:51.055444+0000) 2021-08-03T12:55:51.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:51.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:51.643147+0000) 2021-08-03T12:55:51.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:51.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:51.724950+0000) 2021-08-03T12:55:51.859 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:51.854+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:51.854825+0000) 2021-08-03T12:55:52.060 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:52.055+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:52.055941+0000) 2021-08-03T12:55:52.354 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:52.349+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:52.350284+0000) 2021-08-03T12:55:52.643 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:52.638+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:52.639303+0000) 2021-08-03T12:55:52.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:52.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:52.643298+0000) 2021-08-03T12:55:52.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:52.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:52.725155+0000) 2021-08-03T12:55:52.859 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:52.854+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:52.855468+0000) 2021-08-03T12:55:53.061 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:53.055+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:53.056516+0000) 2021-08-03T12:55:53.355 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:53.350+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:53.351343+0000) 2021-08-03T12:55:53.492 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:55:53.421+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9079 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:55:53.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:53.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:53.643443+0000) 2021-08-03T12:55:53.728 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:53.724+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:53.725299+0000) 2021-08-03T12:55:53.831 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:55:53.647+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:55:53.860 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:53.855+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:53.856050+0000) 2021-08-03T12:55:54.021 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:55:54.015+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8710 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:55:54.356 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:54.351+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:54.351965+0000) 2021-08-03T12:55:54.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:54.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:54.643584+0000) 2021-08-03T12:55:54.806 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:54.802+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:54.803334+0000) 2021-08-03T12:55:54.861 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:54.856+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:54.856669+0000) 2021-08-03T12:55:55.356 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:55.351+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:55.352586+0000) 2021-08-03T12:55:55.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:55.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:55.643706+0000) 2021-08-03T12:55:55.861 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:55.856+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:55.857480+0000) 2021-08-03T12:55:56.148 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:56.144+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.145198+0000) 2021-08-03T12:55:56.172 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:56.165+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.167048+0000) 2021-08-03T12:55:56.357 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:56.351+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.353429+0000) 2021-08-03T12:55:56.526 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:56.520+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.522193+0000) 2021-08-03T12:55:56.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:56.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.643861+0000) 2021-08-03T12:55:56.755 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:55:56.749+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.750488+0000) 2021-08-03T12:55:56.863 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:56.858+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.859399+0000) 2021-08-03T12:55:56.870 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:56.866+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:56.867549+0000) 2021-08-03T12:55:57.148 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:57.144+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:57.145333+0000) 2021-08-03T12:55:57.358 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:57.352+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:57.354482+0000) 2021-08-03T12:55:57.527 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:57.521+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:57.522970+0000) 2021-08-03T12:55:57.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:57.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:57.644021+0000) 2021-08-03T12:55:57.864 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:57.859+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:57.860198+0000) 2021-08-03T12:55:58.148 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:58.144+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:58.145456+0000) 2021-08-03T12:55:58.248 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:55:58.242+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:58.243348+0000) 2021-08-03T12:55:58.360 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:58.353+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:58.355551+0000) 2021-08-03T12:55:58.531 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:58.521+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:58.523782+0000) 2021-08-03T12:55:58.629 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:55:58.623+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:58.625860+0000) 2021-08-03T12:55:58.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:58.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:58.644172+0000) 2021-08-03T12:55:58.865 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:58.860+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:58.860779+0000) 2021-08-03T12:55:59.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:59.144+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:59.145640+0000) 2021-08-03T12:55:59.360 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:55:59.354+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:59.356110+0000) 2021-08-03T12:55:59.534 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:55:59.528+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:59.530531+0000) 2021-08-03T12:55:59.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:55:59.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:59.644317+0000) 2021-08-03T12:55:59.717 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:55:59.709+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:59.711654+0000) 2021-08-03T12:55:59.865 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:55:59.860+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:55:59.861326+0000) 2021-08-03T12:56:00.075 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:00.069+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:00.070299+0000) 2021-08-03T12:56:00.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:00.144+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:00.145783+0000) 2021-08-03T12:56:00.189 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:00.166+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9083 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:00.361 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:00.355+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:00.356963+0000) 2021-08-03T12:56:00.536 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:00.529+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:00.531530+0000) 2021-08-03T12:56:00.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:00.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:00.644417+0000) 2021-08-03T12:56:00.866 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:00.861+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:00.861922+0000) 2021-08-03T12:56:01.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:01.145+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:01.145942+0000) 2021-08-03T12:56:01.360 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:01.165+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8720 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:01.361 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:01.355+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:01.357574+0000) 2021-08-03T12:56:01.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:01.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:01.644579+0000) 2021-08-03T12:56:01.866 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:01.861+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:01.862500+0000) 2021-08-03T12:56:02.043 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:02.035+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:02.037524+0000) 2021-08-03T12:56:02.107 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:02.103+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:02.104441+0000) 2021-08-03T12:56:02.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:02.145+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:02.146054+0000) 2021-08-03T12:56:02.363 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:02.356+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:02.358378+0000) 2021-08-03T12:56:02.439 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:02.433+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:02.435645+0000) 2021-08-03T12:56:02.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:02.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:02.644701+0000) 2021-08-03T12:56:02.867 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:02.862+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:02.863478+0000) 2021-08-03T12:56:02.878 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:02.725+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:03.006 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:03.001+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:03.002701+0000) 2021-08-03T12:56:03.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:03.145+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:03.146204+0000) 2021-08-03T12:56:03.868 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:03.863+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:03.864246+0000) 2021-08-03T12:56:04.149 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:04.145+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:04.146328+0000) 2021-08-03T12:56:04.361 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:04.356+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:04.356822+0000) 2021-08-03T12:56:04.869 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:04.864+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:04.864832+0000) 2021-08-03T12:56:04.993 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:04.988+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:04.989099+0000) 2021-08-03T12:56:05.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:05.145+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:05.146491+0000) 2021-08-03T12:56:05.343 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:05.337+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:05.337809+0000) 2021-08-03T12:56:05.869 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:05.864+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:05.865428+0000) 2021-08-03T12:56:06.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:06.145+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:06.146591+0000) 2021-08-03T12:56:06.470 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:06.466+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:06.467521+0000) 2021-08-03T12:56:06.585 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:06.406+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9086 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:06.871 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:06.866+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:06.867273+0000) 2021-08-03T12:56:07.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:07.145+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:07.146764+0000) 2021-08-03T12:56:07.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:07.466+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:07.467663+0000) 2021-08-03T12:56:07.872 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:07.867+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:07.867869+0000) 2021-08-03T12:56:08.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:08.058+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:08.059149+0000) 2021-08-03T12:56:08.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:08.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:08.146897+0000) 2021-08-03T12:56:08.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:08.466+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:08.467790+0000) 2021-08-03T12:56:08.833 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:08.828+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:08.828868+0000) 2021-08-03T12:56:08.872 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:08.867+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:08.868472+0000) 2021-08-03T12:56:09.065 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:09.060+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:09.061668+0000) 2021-08-03T12:56:09.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:09.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:09.147024+0000) 2021-08-03T12:56:09.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:09.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:09.467924+0000) 2021-08-03T12:56:09.833 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:09.828+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:09.829585+0000) 2021-08-03T12:56:09.873 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:09.868+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:09.869068+0000) 2021-08-03T12:56:10.067 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:10.063+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:10.064176+0000) 2021-08-03T12:56:10.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:10.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:10.147147+0000) 2021-08-03T12:56:10.238 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:10.065+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8761 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:10.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:10.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:10.468026+0000) 2021-08-03T12:56:10.835 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:10.829+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:10.830564+0000) 2021-08-03T12:56:10.874 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:10.868+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:10.869683+0000) 2021-08-03T12:56:11.069 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:11.064+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:11.065656+0000) 2021-08-03T12:56:11.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:11.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:11.147284+0000) 2021-08-03T12:56:11.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:11.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:11.468138+0000) 2021-08-03T12:56:11.783 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:11.758+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:11.835 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:11.830+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:11.831137+0000) 2021-08-03T12:56:11.874 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:11.869+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:11.870283+0000) 2021-08-03T12:56:12.069 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:12.065+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:12.065845+0000) 2021-08-03T12:56:12.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:12.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:12.147403+0000) 2021-08-03T12:56:12.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:12.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:12.468280+0000) 2021-08-03T12:56:12.835 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:12.831+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:12.831750+0000) 2021-08-03T12:56:12.875 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:12.870+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:12.870883+0000) 2021-08-03T12:56:13.069 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:13.065+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:13.066029+0000) 2021-08-03T12:56:13.150 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:13.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:13.147539+0000) 2021-08-03T12:56:13.428 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:13.139+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9092 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:13.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:13.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:13.468409+0000) 2021-08-03T12:56:13.836 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:13.831+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:13.832317+0000) 2021-08-03T12:56:13.876 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:13.870+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:13.871648+0000) 2021-08-03T12:56:14.069 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:14.065+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:14.066176+0000) 2021-08-03T12:56:14.151 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:14.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:14.147652+0000) 2021-08-03T12:56:14.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:14.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:14.468556+0000) 2021-08-03T12:56:14.837 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:14.832+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:14.832821+0000) 2021-08-03T12:56:14.876 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:14.871+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:14.872490+0000) 2021-08-03T12:56:15.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:15.065+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:15.066455+0000) 2021-08-03T12:56:15.151 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:15.146+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:15.147780+0000) 2021-08-03T12:56:15.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:15.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:15.468676+0000) 2021-08-03T12:56:15.837 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:15.832+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:15.833523+0000) 2021-08-03T12:56:15.878 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:15.872+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:15.873052+0000) 2021-08-03T12:56:16.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:16.065+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:16.066609+0000) 2021-08-03T12:56:16.151 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:16.147+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:16.147903+0000) 2021-08-03T12:56:16.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:16.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:16.468836+0000) 2021-08-03T12:56:16.838 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:16.833+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:16.834273+0000) 2021-08-03T12:56:17.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:17.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:17.066828+0000) 2021-08-03T12:56:17.143 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:16.556+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8791 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:17.381 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:17.337+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:17.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:17.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:17.468979+0000) 2021-08-03T12:56:17.839 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:17.834+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:17.834887+0000) 2021-08-03T12:56:18.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:18.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:18.067010+0000) 2021-08-03T12:56:18.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:18.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:18.469112+0000) 2021-08-03T12:56:18.839 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:18.834+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:18.835628+0000) 2021-08-03T12:56:19.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:19.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:19.067255+0000) 2021-08-03T12:56:19.172 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:19.168+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:19.169319+0000) 2021-08-03T12:56:19.293 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:19.210+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9097 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:19.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:19.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:19.469254+0000) 2021-08-03T12:56:19.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:19.705+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:19.706280+0000) 2021-08-03T12:56:19.841 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:19.836+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:19.837095+0000) 2021-08-03T12:56:19.898 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:19.893+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:19.893748+0000) 2021-08-03T12:56:19.981 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:56:19.975+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:19.976661+0000) 2021-08-03T12:56:20.070 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:20.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:20.067402+0000) 2021-08-03T12:56:20.331 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:20.325+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:20.326957+0000) 2021-08-03T12:56:20.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:20.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:20.469390+0000) 2021-08-03T12:56:20.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:20.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:20.520403+0000) 2021-08-03T12:56:20.842 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:20.836+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:20.838224+0000) 2021-08-03T12:56:21.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:21.065+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:21.067645+0000) 2021-08-03T12:56:21.312 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:21.307+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:21.308784+0000) 2021-08-03T12:56:21.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:21.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:21.469520+0000) 2021-08-03T12:56:21.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:21.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:21.520559+0000) 2021-08-03T12:56:21.674 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:21.668+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:21.669288+0000) 2021-08-03T12:56:21.844 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:21.838+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:21.839942+0000) 2021-08-03T12:56:22.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:22.065+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:22.067797+0000) 2021-08-03T12:56:22.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:22.467+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:22.469655+0000) 2021-08-03T12:56:22.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:22.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:22.520673+0000) 2021-08-03T12:56:22.800 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:22.793+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:22.794774+0000) 2021-08-03T12:56:22.807 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:22.801+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:22.846 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:22.840+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:22.842067+0000) 2021-08-03T12:56:23.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:23.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:23.068042+0000) 2021-08-03T12:56:23.368 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:23.362+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:23.363593+0000) 2021-08-03T12:56:23.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:23.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:23.469810+0000) 2021-08-03T12:56:23.524 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:23.519+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:23.520798+0000) 2021-08-03T12:56:23.847 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:23.841+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:23.843681+0000) 2021-08-03T12:56:24.065 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:24.059+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:24.061557+0000) 2021-08-03T12:56:24.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:24.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:24.068188+0000) 2021-08-03T12:56:24.091 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:24.016+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8804 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:24.148 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:24.142+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:24.143364+0000) 2021-08-03T12:56:24.369 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:24.363+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:24.364732+0000) 2021-08-03T12:56:24.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:24.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:24.469929+0000) 2021-08-03T12:56:24.849 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:24.843+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:24.844790+0000) 2021-08-03T12:56:25.066 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:25.060+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:25.062465+0000) 2021-08-03T12:56:25.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:25.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:25.068400+0000) 2021-08-03T12:56:25.369 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:25.364+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:25.365668+0000) 2021-08-03T12:56:25.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:25.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:25.470097+0000) 2021-08-03T12:56:25.850 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:25.843+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:25.845721+0000) 2021-08-03T12:56:26.067 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:26.061+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:26.063061+0000) 2021-08-03T12:56:26.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:26.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:26.068554+0000) 2021-08-03T12:56:26.372 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:26.366+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:26.367019+0000) 2021-08-03T12:56:26.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:26.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:26.470213+0000) 2021-08-03T12:56:26.661 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:26.640+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9109 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:26.837 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:26.832+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:26.832993+0000) 2021-08-03T12:56:26.850 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:26.844+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:26.846692+0000) 2021-08-03T12:56:26.988 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:26.982+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:26.983732+0000) 2021-08-03T12:56:27.067 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:27.061+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:27.063627+0000) 2021-08-03T12:56:27.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:27.066+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:27.068785+0000) 2021-08-03T12:56:27.372 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:27.367+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:27.368397+0000) 2021-08-03T12:56:27.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:27.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:27.470338+0000) 2021-08-03T12:56:27.838 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:27.832+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:27.833703+0000) 2021-08-03T12:56:27.852 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:27.845+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:27.847633+0000) 2021-08-03T12:56:27.910 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:27.864+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3717 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:27.988 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:27.982+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:27.984489+0000) 2021-08-03T12:56:28.068 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:28.062+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:28.064215+0000) 2021-08-03T12:56:28.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:28.067+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:28.068911+0000) 2021-08-03T12:56:28.373 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:28.368+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:28.369558+0000) 2021-08-03T12:56:28.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:28.468+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:28.470488+0000) 2021-08-03T12:56:28.838 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:28.833+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:28.834320+0000) 2021-08-03T12:56:28.856 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:28.847+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:28.849263+0000) 2021-08-03T12:56:28.989 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:28.983+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:28.985087+0000) 2021-08-03T12:56:29.068 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:29.064+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:29.064827+0000) 2021-08-03T12:56:29.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:29.068+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:29.069172+0000) 2021-08-03T12:56:29.375 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:29.369+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:29.370728+0000) 2021-08-03T12:56:29.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:29.469+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:29.470637+0000) 2021-08-03T12:56:29.839 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:29.834+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:29.835408+0000) 2021-08-03T12:56:29.989 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:29.984+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:29.985703+0000) 2021-08-03T12:56:30.069 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:30.064+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:30.065412+0000) 2021-08-03T12:56:30.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:30.068+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:30.069320+0000) 2021-08-03T12:56:30.377 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:30.371+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:30.372220+0000) 2021-08-03T12:56:30.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:30.469+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:30.470776+0000) 2021-08-03T12:56:30.840 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:30.835+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:30.835997+0000) 2021-08-03T12:56:30.990 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:30.985+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:30.986339+0000) 2021-08-03T12:56:31.070 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:31.065+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:31.066010+0000) 2021-08-03T12:56:31.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:31.068+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:31.069552+0000) 2021-08-03T12:56:31.378 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:31.372+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:31.373461+0000) 2021-08-03T12:56:31.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:31.470+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:31.470929+0000) 2021-08-03T12:56:31.539 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:31.534+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:31.535003+0000) 2021-08-03T12:56:31.841 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:31.836+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:31.836786+0000) 2021-08-03T12:56:31.991 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:31.986+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:31.986899+0000) 2021-08-03T12:56:32.070 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:32.065+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:32.066601+0000) 2021-08-03T12:56:32.073 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:32.068+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:32.069692+0000) 2021-08-03T12:56:32.320 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:56:32.314+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:32.315086+0000) 2021-08-03T12:56:32.539 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:32.534+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:32.535749+0000) 2021-08-03T12:56:32.841 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:32.836+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:32.837558+0000) 2021-08-03T12:56:32.991 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:32.986+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:32.987457+0000) 2021-08-03T12:56:33.073 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:33.069+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:33.070335+0000) 2021-08-03T12:56:33.172 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:33.042+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8804 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:33.253 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:33.249+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:33.250358+0000) 2021-08-03T12:56:33.377 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:33.371+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:33.372490+0000) 2021-08-03T12:56:33.691 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:33.687+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:33.688064+0000) 2021-08-03T12:56:33.753 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:33.683+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9121 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:33.762 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:33.756+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:33.757348+0000) 2021-08-03T12:56:33.992 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:33.987+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:33.988248+0000) 2021-08-03T12:56:34.649 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:34.645+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:34.646194+0000) 2021-08-03T12:56:34.993 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:34.988+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:34.988871+0000) 2021-08-03T12:56:35.018 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:35.013+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:35.014778+0000) 2021-08-03T12:56:35.018 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:35.014+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:35.015408+0000) 2021-08-03T12:56:35.649 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:35.645+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:35.646335+0000) 2021-08-03T12:56:35.940 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:35.936+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:35.937405+0000) 2021-08-03T12:56:35.993 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:35.988+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:35.989470+0000) 2021-08-03T12:56:36.400 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:56:36.394+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:36.395133+0000) 2021-08-03T12:56:36.442 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:36.437+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3718 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:36.877 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:36.870+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:36.871197+0000) 2021-08-03T12:56:36.994 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:36.989+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:36.990686+0000) 2021-08-03T12:56:37.435 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:37.428+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:37.429734+0000) 2021-08-03T12:56:37.703 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:37.697+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:37.698558+0000) 2021-08-03T12:56:38.352 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:38.348+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:38.349007+0000) 2021-08-03T12:56:38.510 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:38.504+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:38.505034+0000) 2021-08-03T12:56:38.882 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:56:38.876+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:38.877496+0000) 2021-08-03T12:56:39.171 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:38.962+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8804 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:39.335 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:39.329+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:39.330222+0000) 2021-08-03T12:56:39.823 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:39.819+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:39.820257+0000) 2021-08-03T12:56:41.073 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:40.844+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9133 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:41.215 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:41.209+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:41.210403+0000) 2021-08-03T12:56:42.029 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:42.023+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:42.023964+0000) 2021-08-03T12:56:42.036 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:42.032+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:42.033233+0000) 2021-08-03T12:56:42.189 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:42.184+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:42.185590+0000) 2021-08-03T12:56:42.278 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:42.271+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:42.272499+0000) 2021-08-03T12:56:42.571 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:42.567+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:42.568420+0000) 2021-08-03T12:56:42.836 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:42.830+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:42.830777+0000) 2021-08-03T12:56:42.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:42.896+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:42.897443+0000) 2021-08-03T12:56:43.190 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:43.185+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:43.186329+0000) 2021-08-03T12:56:43.772 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:43.663+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3718 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:43.787 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:56:43.782+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:43.783215+0000) 2021-08-03T12:56:44.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:44.186+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:44.186914+0000) 2021-08-03T12:56:44.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:44.534+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:44.535469+0000) 2021-08-03T12:56:45.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:45.186+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:45.187464+0000) 2021-08-03T12:56:45.423 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:56:45.418+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:45.419217+0000) 2021-08-03T12:56:45.597 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:45.593+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:45.594198+0000) 2021-08-03T12:56:46.061 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:45.977+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8804 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:46.193 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:46.187+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:46.188561+0000) 2021-08-03T12:56:46.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:46.770+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:46.771738+0000) 2021-08-03T12:56:47.193 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:47.188+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:47.189300+0000) 2021-08-03T12:56:47.576 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:47.572+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:47.573045+0000) 2021-08-03T12:56:47.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:47.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:47.771842+0000) 2021-08-03T12:56:48.194 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:48.189+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:48.189915+0000) 2021-08-03T12:56:48.536 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:48.372+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9133 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:48.572 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:56:48.567+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:48.567999+0000) 2021-08-03T12:56:48.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:48.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:48.771956+0000) 2021-08-03T12:56:49.120 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:49.116+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:49.117215+0000) 2021-08-03T12:56:49.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:49.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:49.772071+0000) 2021-08-03T12:56:49.910 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:49.903+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:49.904270+0000) 2021-08-03T12:56:50.531 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:56:50.525+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:50.526034+0000) 2021-08-03T12:56:50.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:50.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:50.772225+0000) 2021-08-03T12:56:50.869 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:50.864+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:50.865620+0000) 2021-08-03T12:56:51.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:51.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:51.772352+0000) 2021-08-03T12:56:52.382 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:52.377+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:52.377772+0000) 2021-08-03T12:56:52.445 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:52.439+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:52.440047+0000) 2021-08-03T12:56:52.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:52.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:52.772511+0000) 2021-08-03T12:56:52.961 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:52.955+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8814 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:53.383 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:53.377+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:53.378761+0000) 2021-08-03T12:56:53.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:53.771+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:53.772630+0000) 2021-08-03T12:56:53.865 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:53.623+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3720 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:56:54.383 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:54.378+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:54.379355+0000) 2021-08-03T12:56:54.697 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:54.692+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:54.693762+0000) 2021-08-03T12:56:54.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:54.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:54.772808+0000) 2021-08-03T12:56:55.384 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:55.379+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:55.379934+0000) 2021-08-03T12:56:55.423 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:55.418+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:55.418751+0000) 2021-08-03T12:56:55.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:55.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:55.772906+0000) 2021-08-03T12:56:55.950 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:55.946+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:55.947261+0000) 2021-08-03T12:56:56.384 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:56.379+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:56.380538+0000) 2021-08-03T12:56:56.498 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:56:56.442+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9133 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:56:56.681 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:56.677+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:56.677811+0000) 2021-08-03T12:56:56.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:56.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:56.773021+0000) 2021-08-03T12:56:56.950 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:56.946+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:56.947406+0000) 2021-08-03T12:56:57.266 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:56:57.260+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:57.261775+0000) 2021-08-03T12:56:57.385 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:57.380+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:57.381196+0000) 2021-08-03T12:56:57.760 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:56:57.754+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:57.755041+0000) 2021-08-03T12:56:57.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:57.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:57.773155+0000) 2021-08-03T12:56:57.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:57.946+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:57.947550+0000) 2021-08-03T12:56:58.113 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:56:58.108+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:58.108879+0000) 2021-08-03T12:56:58.386 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:58.381+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:58.381835+0000) 2021-08-03T12:56:58.752 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:58.748+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:58.749102+0000) 2021-08-03T12:56:58.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:58.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:58.773275+0000) 2021-08-03T12:56:58.861 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:56:58.855+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:58.855979+0000) 2021-08-03T12:56:58.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:58.946+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:58.947695+0000) 2021-08-03T12:56:58.977 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:56:58.969+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8826 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:56:59.387 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:56:59.382+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:59.382828+0000) 2021-08-03T12:56:59.692 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:59.687+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:59.688683+0000) 2021-08-03T12:56:59.764 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:59.759+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:59.760349+0000) 2021-08-03T12:56:59.776 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:56:59.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:59.773379+0000) 2021-08-03T12:56:59.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:56:59.946+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:56:59.947825+0000) 2021-08-03T12:57:00.211 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:56:59.957+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3720 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:00.259 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:00.253+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:00.253986+0000) 2021-08-03T12:57:00.388 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:00.382+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:00.383771+0000) 2021-08-03T12:57:00.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:00.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:00.773532+0000) 2021-08-03T12:57:00.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:00.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:00.947930+0000) 2021-08-03T12:57:01.388 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:01.383+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:01.384374+0000) 2021-08-03T12:57:01.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:01.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:01.773664+0000) 2021-08-03T12:57:01.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:01.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:01.948045+0000) 2021-08-03T12:57:02.390 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:02.384+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:02.385184+0000) 2021-08-03T12:57:02.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:02.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:02.773810+0000) 2021-08-03T12:57:02.944 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:02.938+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:02.939528+0000) 2021-08-03T12:57:02.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:02.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:02.948166+0000) 2021-08-03T12:57:03.075 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:03.069+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:03.070360+0000) 2021-08-03T12:57:03.390 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:03.385+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:03.385912+0000) 2021-08-03T12:57:03.546 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:03.540+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:03.541474+0000) 2021-08-03T12:57:03.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:03.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:03.773960+0000) 2021-08-03T12:57:03.848 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:03.842+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:03.843690+0000) 2021-08-03T12:57:03.951 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:03.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:03.948318+0000) 2021-08-03T12:57:04.075 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:04.070+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:04.071115+0000) 2021-08-03T12:57:04.122 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:04.118+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:04.119093+0000) 2021-08-03T12:57:04.391 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:04.385+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:04.386535+0000) 2021-08-03T12:57:04.423 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:04.156+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9140 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:04.428 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:04.422+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:04.423176+0000) 2021-08-03T12:57:04.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:04.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:04.774096+0000) 2021-08-03T12:57:04.848 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:04.843+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:04.844666+0000) 2021-08-03T12:57:04.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:04.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:04.948454+0000) 2021-08-03T12:57:05.076 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:05.071+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.071881+0000) 2021-08-03T12:57:05.367 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:05.361+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.362587+0000) 2021-08-03T12:57:05.391 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:05.386+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.387403+0000) 2021-08-03T12:57:05.551 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:05.131+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3720 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:05.580 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:05.507+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8826 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:05.663 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:05.658+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.659483+0000) 2021-08-03T12:57:05.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:05.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.774227+0000) 2021-08-03T12:57:05.840 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:05.835+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.836800+0000) 2021-08-03T12:57:05.849 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:05.844+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.845264+0000) 2021-08-03T12:57:05.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:05.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:05.948570+0000) 2021-08-03T12:57:06.076 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:06.071+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:06.072497+0000) 2021-08-03T12:57:06.392 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:06.386+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:06.388266+0000) 2021-08-03T12:57:06.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:06.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:06.774367+0000) 2021-08-03T12:57:06.850 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:06.844+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:06.845844+0000) 2021-08-03T12:57:06.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:06.946+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:06.948710+0000) 2021-08-03T12:57:07.077 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:07.072+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:07.073125+0000) 2021-08-03T12:57:07.393 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:07.387+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:07.389084+0000) 2021-08-03T12:57:07.403 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:07.397+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:07.399039+0000) 2021-08-03T12:57:07.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:07.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:07.774517+0000) 2021-08-03T12:57:07.851 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:07.844+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:07.846400+0000) 2021-08-03T12:57:07.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:07.946+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:07.948835+0000) 2021-08-03T12:57:08.078 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:08.073+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:08.073732+0000) 2021-08-03T12:57:08.394 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:08.387+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:08.389728+0000) 2021-08-03T12:57:08.403 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:08.397+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:08.399760+0000) 2021-08-03T12:57:08.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:08.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:08.774650+0000) 2021-08-03T12:57:08.851 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:08.845+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:08.847148+0000) 2021-08-03T12:57:08.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:08.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:08.948965+0000) 2021-08-03T12:57:09.030 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:09.025+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.027424+0000) 2021-08-03T12:57:09.078 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:09.072+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.074334+0000) 2021-08-03T12:57:09.394 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:09.388+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.390421+0000) 2021-08-03T12:57:09.405 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:09.399+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.400800+0000) 2021-08-03T12:57:09.729 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:09.721+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.723464+0000) 2021-08-03T12:57:09.740 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:09.710+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9169 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:09.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:09.772+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.774768+0000) 2021-08-03T12:57:09.851 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:09.845+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.847702+0000) 2021-08-03T12:57:09.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:09.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:09.949100+0000) 2021-08-03T12:57:10.031 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:10.025+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:10.027575+0000) 2021-08-03T12:57:10.395 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:10.389+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:10.391041+0000) 2021-08-03T12:57:10.405 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:10.399+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:10.401383+0000) 2021-08-03T12:57:10.474 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:10.467+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:10.469173+0000) 2021-08-03T12:57:10.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:10.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:10.774872+0000) 2021-08-03T12:57:10.852 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:10.846+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:10.848259+0000) 2021-08-03T12:57:10.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:10.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:10.949219+0000) 2021-08-03T12:57:11.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:11.065+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:11.067660+0000) 2021-08-03T12:57:11.141 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:11.037+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8826 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:11.236 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:11.229+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3720 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:11.396 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:11.389+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:11.391641+0000) 2021-08-03T12:57:11.402 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:11.395+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:11.397033+0000) 2021-08-03T12:57:11.499 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:11.492+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:11.493790+0000) 2021-08-03T12:57:11.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:11.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:11.774985+0000) 2021-08-03T12:57:11.853 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:11.847+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:11.849018+0000) 2021-08-03T12:57:11.953 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:11.947+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:11.949334+0000) 2021-08-03T12:57:12.398 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:12.390+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:12.392251+0000) 2021-08-03T12:57:12.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:12.773+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:12.775155+0000) 2021-08-03T12:57:12.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:12.796+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:12.798240+0000) 2021-08-03T12:57:12.853 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:12.847+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:12.849606+0000) 2021-08-03T12:57:12.929 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:12.922+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:12.924313+0000) 2021-08-03T12:57:12.952 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:12.948+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:12.949467+0000) 2021-08-03T12:57:13.172 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:13.165+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:13.167356+0000) 2021-08-03T12:57:13.209 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:13.204+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:13.206090+0000) 2021-08-03T12:57:13.568 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:13.560+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:13.562544+0000) 2021-08-03T12:57:13.611 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:13.606+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:13.608075+0000) 2021-08-03T12:57:13.892 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:13.887+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:13.888808+0000) 2021-08-03T12:57:13.953 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:13.948+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:13.949614+0000) 2021-08-03T12:57:14.895 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:14.889+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:14.891390+0000) 2021-08-03T12:57:14.953 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:14.948+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:14.949725+0000) 2021-08-03T12:57:15.223 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:15.218+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:15.220284+0000) 2021-08-03T12:57:15.883 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:15.877+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:15.878002+0000) 2021-08-03T12:57:15.897 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:15.892+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:15.894004+0000) 2021-08-03T12:57:15.953 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:15.948+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:15.949851+0000) 2021-08-03T12:57:16.402 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:16.348+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9199 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:16.899 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:16.893+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:16.895527+0000) 2021-08-03T12:57:16.953 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:16.949+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:16.949982+0000) 2021-08-03T12:57:17.559 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:17.553+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:17.553833+0000) 2021-08-03T12:57:17.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:17.774+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:17.775120+0000) 2021-08-03T12:57:17.899 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:17.894+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:17.895654+0000) 2021-08-03T12:57:17.953 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:17.949+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:17.950119+0000) 2021-08-03T12:57:17.984 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:17.979+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:17.980037+0000) 2021-08-03T12:57:18.099 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:18.043+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8826 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:18.953 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:18.949+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:18.950249+0000) 2021-08-03T12:57:19.041 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:19.035+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:19.036004+0000) 2021-08-03T12:57:19.081 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:19.075+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:19.076235+0000) 2021-08-03T12:57:19.118 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:19.113+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:19.114025+0000) 2021-08-03T12:57:19.240 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:19.234+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3720 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:19.523 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:19.517+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:19.517916+0000) 2021-08-03T12:57:19.595 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:19.587+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:19.588079+0000) 2021-08-03T12:57:20.119 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:20.114+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:20.114759+0000) 2021-08-03T12:57:20.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:20.121+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:20.122172+0000) 2021-08-03T12:57:20.189 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:20.182+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:20.183538+0000) 2021-08-03T12:57:20.600 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:20.594+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:20.595081+0000) 2021-08-03T12:57:20.942 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:20.937+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:20.938831+0000) 2021-08-03T12:57:21.119 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:21.114+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:21.115354+0000) 2021-08-03T12:57:21.951 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:21.945+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:21.945906+0000) 2021-08-03T12:57:22.120 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:22.115+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:22.115993+0000) 2021-08-03T12:57:22.191 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:22.187+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:22.187915+0000) 2021-08-03T12:57:22.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:22.209+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:22.209938+0000) 2021-08-03T12:57:22.534 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:22.529+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:22.529772+0000) 2021-08-03T12:57:23.121 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:23.115+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:23.116562+0000) 2021-08-03T12:57:23.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:23.223+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:23.224324+0000) 2021-08-03T12:57:23.535 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:23.529+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:23.530506+0000) 2021-08-03T12:57:24.095 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:24.073+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8826 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:24.121 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:24.116+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:24.117122+0000) 2021-08-03T12:57:24.169 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:24.164+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:24.164960+0000) 2021-08-03T12:57:24.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:24.360+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:24.361281+0000) 2021-08-03T12:57:24.535 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:24.530+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:24.531105+0000) 2021-08-03T12:57:24.772 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:24.626+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9220 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:24.934 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:24.930+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:24.931352+0000) 2021-08-03T12:57:25.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:25.360+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:25.361476+0000) 2021-08-03T12:57:25.536 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:25.531+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:25.531867+0000) 2021-08-03T12:57:25.559 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:25.553+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:25.554061+0000) 2021-08-03T12:57:26.006 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:26.000+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:26.001228+0000) 2021-08-03T12:57:26.113 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:26.108+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:26.109016+0000) 2021-08-03T12:57:26.320 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:26.314+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:26.315696+0000) 2021-08-03T12:57:26.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:26.360+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:26.361603+0000) 2021-08-03T12:57:26.466 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:26.462+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:26.463492+0000) 2021-08-03T12:57:26.537 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:26.531+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:26.532655+0000) 2021-08-03T12:57:27.166 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:27.162+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:27.163132+0000) 2021-08-03T12:57:27.365 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:27.360+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:27.361776+0000) 2021-08-03T12:57:27.538 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:27.532+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:27.533356+0000) 2021-08-03T12:57:27.732 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:26.794+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3721 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:28.538 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:28.533+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:28.534171+0000) 2021-08-03T12:57:28.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:28.958+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:28.959560+0000) 2021-08-03T12:57:29.539 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:29.534+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:29.534953+0000) 2021-08-03T12:57:30.018 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:30.012+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:30.012870+0000) 2021-08-03T12:57:30.174 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:30.167+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8828 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:30.336 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:30.186+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9225 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:30.540 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:30.535+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:30.536117+0000) 2021-08-03T12:57:30.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:30.649+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:30.650778+0000) 2021-08-03T12:57:31.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:31.243+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:31.243958+0000) 2021-08-03T12:57:31.541 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:31.535+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:31.536692+0000) 2021-08-03T12:57:31.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:31.650+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:31.650940+0000) 2021-08-03T12:57:32.477 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:32.470+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:32.471519+0000) 2021-08-03T12:57:32.541 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:32.536+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:32.537331+0000) 2021-08-03T12:57:32.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:32.650+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:32.651086+0000) 2021-08-03T12:57:32.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:32.943+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:32.944778+0000) 2021-08-03T12:57:32.953 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:32.949+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:32.949898+0000) 2021-08-03T12:57:32.973 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:32.966+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:32.967436+0000) 2021-08-03T12:57:33.476 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:33.470+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:33.471032+0000) 2021-08-03T12:57:33.514 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:33.508+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:33.509327+0000) 2021-08-03T12:57:33.541 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:33.537+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:33.538350+0000) 2021-08-03T12:57:33.542 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:33.537+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:33.538004+0000) 2021-08-03T12:57:33.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:33.650+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:33.651221+0000) 2021-08-03T12:57:34.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:34.082+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:34.083702+0000) 2021-08-03T12:57:34.542 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:34.537+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:34.538573+0000) 2021-08-03T12:57:34.550 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:34.545+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:34.546642+0000) 2021-08-03T12:57:34.625 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:34.620+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:34.621142+0000) 2021-08-03T12:57:34.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:34.650+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:34.651384+0000) 2021-08-03T12:57:34.662 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:34.657+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3721 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:35.090 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:35.085+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:35.086296+0000) 2021-08-03T12:57:35.544 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:35.538+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:35.539437+0000) 2021-08-03T12:57:35.551 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:35.546+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:35.547389+0000) 2021-08-03T12:57:35.625 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:35.621+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:35.621804+0000) 2021-08-03T12:57:35.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:35.650+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:35.651506+0000) 2021-08-03T12:57:35.959 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:35.954+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:35.955199+0000) 2021-08-03T12:57:36.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:36.088+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:36.088901+0000) 2021-08-03T12:57:36.462 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:36.456+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:36.457531+0000) 2021-08-03T12:57:36.552 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:36.547+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:36.548004+0000) 2021-08-03T12:57:36.601 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:36.529+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9242 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:36.626 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:36.621+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:36.622363+0000) 2021-08-03T12:57:36.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:36.650+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:36.651666+0000) 2021-08-03T12:57:36.781 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:36.704+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8828 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:37.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:37.089+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:37.090467+0000) 2021-08-03T12:57:37.555 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:37.548+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:37.549164+0000) 2021-08-03T12:57:37.627 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:37.622+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:37.622938+0000) 2021-08-03T12:57:37.642 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:37.637+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:37.638167+0000) 2021-08-03T12:57:37.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:37.650+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:37.651782+0000) 2021-08-03T12:57:37.968 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:37.964+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:37.964832+0000) 2021-08-03T12:57:38.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:38.089+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:38.090645+0000) 2021-08-03T12:57:38.554 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:38.549+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:38.549944+0000) 2021-08-03T12:57:38.627 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:38.622+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:38.623501+0000) 2021-08-03T12:57:38.636 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:38.630+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:38.631295+0000) 2021-08-03T12:57:38.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:38.651+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:38.651931+0000) 2021-08-03T12:57:39.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:39.090+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:39.090852+0000) 2021-08-03T12:57:39.126 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:39.120+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:39.121199+0000) 2021-08-03T12:57:39.555 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:39.549+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:39.550543+0000) 2021-08-03T12:57:39.629 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:39.623+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:39.624292+0000) 2021-08-03T12:57:39.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:39.651+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:39.652087+0000) 2021-08-03T12:57:40.083 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:40.078+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:40.078827+0000) 2021-08-03T12:57:40.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:40.090+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:40.091011+0000) 2021-08-03T12:57:40.342 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:40.336+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:40.337419+0000) 2021-08-03T12:57:40.482 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:40.477+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:40.478009+0000) 2021-08-03T12:57:40.555 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:40.550+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:40.551384+0000) 2021-08-03T12:57:40.629 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:40.624+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:40.625103+0000) 2021-08-03T12:57:40.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:40.651+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:40.652222+0000) 2021-08-03T12:57:41.084 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:41.078+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.079550+0000) 2021-08-03T12:57:41.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:41.090+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.091279+0000) 2021-08-03T12:57:41.342 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:41.337+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.338152+0000) 2021-08-03T12:57:41.409 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:41.404+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.405240+0000) 2021-08-03T12:57:41.556 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:41.551+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.552491+0000) 2021-08-03T12:57:41.630 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:41.624+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.625711+0000) 2021-08-03T12:57:41.655 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:41.651+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.652386+0000) 2021-08-03T12:57:41.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:41.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:41.695457+0000) 2021-08-03T12:57:42.084 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:42.079+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.080329+0000) 2021-08-03T12:57:42.095 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:42.090+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.091429+0000) 2021-08-03T12:57:42.343 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:42.338+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.338737+0000) 2021-08-03T12:57:42.410 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:42.405+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.406601+0000) 2021-08-03T12:57:42.557 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:42.552+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.553188+0000) 2021-08-03T12:57:42.630 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:42.625+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.626324+0000) 2021-08-03T12:57:42.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:42.651+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.652521+0000) 2021-08-03T12:57:42.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:42.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:42.695594+0000) 2021-08-03T12:57:43.085 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:43.080+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.080920+0000) 2021-08-03T12:57:43.095 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:43.090+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.091653+0000) 2021-08-03T12:57:43.202 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:43.028+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3723 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:43.344 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:43.339+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.340050+0000) 2021-08-03T12:57:43.411 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:43.406+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.407534+0000) 2021-08-03T12:57:43.558 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:43.553+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.553807+0000) 2021-08-03T12:57:43.631 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:43.626+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.626973+0000) 2021-08-03T12:57:43.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:43.651+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.652636+0000) 2021-08-03T12:57:43.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:43.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.695747+0000) 2021-08-03T12:57:43.857 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:43.852+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:43.853471+0000) 2021-08-03T12:57:44.038 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:44.015+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8844 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:44.085 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:44.080+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.081526+0000) 2021-08-03T12:57:44.095 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:44.090+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.091805+0000) 2021-08-03T12:57:44.350 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:44.341+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.340894+0000) 2021-08-03T12:57:44.412 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:44.407+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.408112+0000) 2021-08-03T12:57:44.419 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:44.364+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9268 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:44.558 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:44.553+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.554375+0000) 2021-08-03T12:57:44.631 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:44.626+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.627543+0000) 2021-08-03T12:57:44.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:44.652+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.652828+0000) 2021-08-03T12:57:44.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:44.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.695859+0000) 2021-08-03T12:57:44.858 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:44.853+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:44.854205+0000) 2021-08-03T12:57:45.095 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:45.091+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.091998+0000) 2021-08-03T12:57:45.128 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:45.122+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.123518+0000) 2021-08-03T12:57:45.346 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:45.341+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.342304+0000) 2021-08-03T12:57:45.413 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:45.407+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.408710+0000) 2021-08-03T12:57:45.559 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:45.554+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.555113+0000) 2021-08-03T12:57:45.633 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:45.627+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.628480+0000) 2021-08-03T12:57:45.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:45.652+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.652981+0000) 2021-08-03T12:57:45.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:45.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.696008+0000) 2021-08-03T12:57:45.859 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:45.854+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:45.854857+0000) 2021-08-03T12:57:46.095 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:46.091+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.092133+0000) 2021-08-03T12:57:46.128 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:46.123+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.124221+0000) 2021-08-03T12:57:46.348 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:46.342+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.343487+0000) 2021-08-03T12:57:46.413 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:46.408+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.409277+0000) 2021-08-03T12:57:46.561 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:46.555+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.556439+0000) 2021-08-03T12:57:46.634 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:46.628+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.629741+0000) 2021-08-03T12:57:46.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:46.652+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.653131+0000) 2021-08-03T12:57:46.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:46.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.696121+0000) 2021-08-03T12:57:46.795 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:46.790+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.791531+0000) 2021-08-03T12:57:46.860 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:46.854+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:46.855655+0000) 2021-08-03T12:57:47.096 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:47.091+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.092425+0000) 2021-08-03T12:57:47.129 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:47.124+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.124764+0000) 2021-08-03T12:57:47.349 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:47.343+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.344602+0000) 2021-08-03T12:57:47.414 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:47.409+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.409893+0000) 2021-08-03T12:57:47.562 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:47.556+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.557658+0000) 2021-08-03T12:57:47.635 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:47.630+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.630787+0000) 2021-08-03T12:57:47.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:47.652+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.653257+0000) 2021-08-03T12:57:47.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:47.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.696251+0000) 2021-08-03T12:57:47.861 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:47.855+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:47.856210+0000) 2021-08-03T12:57:48.096 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:48.091+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.092546+0000) 2021-08-03T12:57:48.129 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:48.124+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.125332+0000) 2021-08-03T12:57:48.350 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:48.344+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.345246+0000) 2021-08-03T12:57:48.415 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:48.410+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.410892+0000) 2021-08-03T12:57:48.514 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:48.508+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3727 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:48.522 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:57:48.516+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.516785+0000) 2021-08-03T12:57:48.563 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:48.557+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.558656+0000) 2021-08-03T12:57:48.635 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:48.630+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.631576+0000) 2021-08-03T12:57:48.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:48.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:48.696388+0000) 2021-08-03T12:57:49.096 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:49.091+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.092799+0000) 2021-08-03T12:57:49.130 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:49.125+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.125925+0000) 2021-08-03T12:57:49.350 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:49.345+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.346029+0000) 2021-08-03T12:57:49.416 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:49.410+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.411504+0000) 2021-08-03T12:57:49.485 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:49.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.482213+0000) 2021-08-03T12:57:49.563 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:49.559+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.559850+0000) 2021-08-03T12:57:49.636 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:49.631+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.632156+0000) 2021-08-03T12:57:49.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:49.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.696533+0000) 2021-08-03T12:57:49.882 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:49.877+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:49.877876+0000) 2021-08-03T12:57:50.004 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:49.888+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9273 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:50.096 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:50.092+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.092947+0000) 2021-08-03T12:57:50.131 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:50.125+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.126509+0000) 2021-08-03T12:57:50.351 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:50.346+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.346772+0000) 2021-08-03T12:57:50.416 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:50.411+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.412710+0000) 2021-08-03T12:57:50.485 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:50.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.482371+0000) 2021-08-03T12:57:50.564 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:50.560+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.560804+0000) 2021-08-03T12:57:50.636 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:50.631+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.632642+0000) 2021-08-03T12:57:50.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:50.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.696662+0000) 2021-08-03T12:57:50.882 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:50.877+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:50.878593+0000) 2021-08-03T12:57:51.096 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:51.092+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.093208+0000) 2021-08-03T12:57:51.131 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:51.126+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.127090+0000) 2021-08-03T12:57:51.352 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:51.346+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.347560+0000) 2021-08-03T12:57:51.418 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:51.412+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.413286+0000) 2021-08-03T12:57:51.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:51.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.482526+0000) 2021-08-03T12:57:51.566 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:51.560+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.561744+0000) 2021-08-03T12:57:51.637 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:51.632+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.633230+0000) 2021-08-03T12:57:51.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:51.695+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.696779+0000) 2021-08-03T12:57:51.883 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:51.878+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:51.879154+0000) 2021-08-03T12:57:51.954 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:51.793+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8854 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:52.096 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:52.092+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.093352+0000) 2021-08-03T12:57:52.132 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:52.126+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.127636+0000) 2021-08-03T12:57:52.352 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:52.347+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.348195+0000) 2021-08-03T12:57:52.418 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:52.413+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.414353+0000) 2021-08-03T12:57:52.479 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:52.475+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.475912+0000) 2021-08-03T12:57:52.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:52.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.482653+0000) 2021-08-03T12:57:52.567 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:52.562+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.562915+0000) 2021-08-03T12:57:52.638 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:52.633+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.634613+0000) 2021-08-03T12:57:52.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:52.696+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.696919+0000) 2021-08-03T12:57:52.781 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:57:52.774+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.775584+0000) 2021-08-03T12:57:52.884 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:52.878+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:52.879707+0000) 2021-08-03T12:57:53.097 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:53.092+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.093580+0000) 2021-08-03T12:57:53.132 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:53.127+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.128457+0000) 2021-08-03T12:57:53.353 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:53.348+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.348786+0000) 2021-08-03T12:57:53.419 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:53.414+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.415430+0000) 2021-08-03T12:57:53.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:53.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.482774+0000) 2021-08-03T12:57:53.568 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:53.563+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.564298+0000) 2021-08-03T12:57:53.639 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:53.634+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.635193+0000) 2021-08-03T12:57:53.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:53.696+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.697062+0000) 2021-08-03T12:57:53.884 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:53.879+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:53.880255+0000) 2021-08-03T12:57:54.097 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:54.092+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.093729+0000) 2021-08-03T12:57:54.133 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:54.128+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.128970+0000) 2021-08-03T12:57:54.353 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:54.348+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.349421+0000) 2021-08-03T12:57:54.420 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:54.415+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.416247+0000) 2021-08-03T12:57:54.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:54.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.482927+0000) 2021-08-03T12:57:54.570 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:54.564+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.565627+0000) 2021-08-03T12:57:54.640 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:54.634+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.635776+0000) 2021-08-03T12:57:54.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:54.696+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.697201+0000) 2021-08-03T12:57:54.884 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:54.880+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:54.880801+0000) 2021-08-03T12:57:55.097 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:55.093+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.093956+0000) 2021-08-03T12:57:55.133 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:55.128+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.129537+0000) 2021-08-03T12:57:55.354 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:55.349+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.350004+0000) 2021-08-03T12:57:55.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:55.402+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.403662+0000) 2021-08-03T12:57:55.421 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:55.416+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.417042+0000) 2021-08-03T12:57:55.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:55.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.483061+0000) 2021-08-03T12:57:55.571 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:55.566+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.566876+0000) 2021-08-03T12:57:55.640 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:57:55.635+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.636537+0000) 2021-08-03T12:57:55.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:55.696+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.697345+0000) 2021-08-03T12:57:55.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:57:55.698+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.699355+0000) 2021-08-03T12:57:55.886 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:55.880+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:55.881700+0000) 2021-08-03T12:57:56.135 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:56.129+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:56.130226+0000) 2021-08-03T12:57:56.355 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:56.350+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:56.351406+0000) 2021-08-03T12:57:56.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:56.402+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:56.403797+0000) 2021-08-03T12:57:56.421 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:56.416+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:56.417615+0000) 2021-08-03T12:57:56.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:56.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:56.483183+0000) 2021-08-03T12:57:56.571 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:56.567+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:56.567807+0000) 2021-08-03T12:57:56.705 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:57:56.657+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3746 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:57:56.734 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:57:56.587+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9285 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:57:56.886 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:56.880+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:56.882297+0000) 2021-08-03T12:57:57.135 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:57.129+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:57.130786+0000) 2021-08-03T12:57:57.356 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:57.350+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:57.351962+0000) 2021-08-03T12:57:57.423 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:57.417+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:57.418539+0000) 2021-08-03T12:57:57.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:57.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:57.483331+0000) 2021-08-03T12:57:57.573 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:57:57.568+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:57.568820+0000) 2021-08-03T12:57:57.887 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:57.881+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:57.883197+0000) 2021-08-03T12:57:58.135 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:58.129+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:58.131354+0000) 2021-08-03T12:57:58.357 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:58.351+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:58.352943+0000) 2021-08-03T12:57:58.424 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:58.418+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:58.419456+0000) 2021-08-03T12:57:58.487 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:58.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:58.483480+0000) 2021-08-03T12:57:58.842 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:57:58.530+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8862 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:57:58.888 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:58.882+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:58.883761+0000) 2021-08-03T12:57:59.139 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:57:59.131+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:59.132721+0000) 2021-08-03T12:57:59.358 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:57:59.351+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:59.353541+0000) 2021-08-03T12:57:59.425 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:57:59.419+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:59.420497+0000) 2021-08-03T12:57:59.487 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:59.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:59.483627+0000) 2021-08-03T12:57:59.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:57:59.699+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:59.701725+0000) 2021-08-03T12:57:59.888 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:57:59.882+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:57:59.884326+0000) 2021-08-03T12:58:00.138 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:00.132+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:00.134203+0000) 2021-08-03T12:58:00.358 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:00.352+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:00.354144+0000) 2021-08-03T12:58:00.425 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:00.420+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:00.421125+0000) 2021-08-03T12:58:00.487 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:00.481+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:00.483784+0000) 2021-08-03T12:58:00.889 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:00.883+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:00.884993+0000) 2021-08-03T12:58:01.049 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:01.042+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:01.044154+0000) 2021-08-03T12:58:01.139 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:01.133+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:01.134927+0000) 2021-08-03T12:58:01.359 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:01.353+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:01.354908+0000) 2021-08-03T12:58:01.426 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:01.420+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:01.421790+0000) 2021-08-03T12:58:01.487 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:01.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:01.483920+0000) 2021-08-03T12:58:01.890 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:01.883+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:01.885548+0000) 2021-08-03T12:58:01.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:01.954+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:01.955901+0000) 2021-08-03T12:58:02.139 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:02.133+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:02.135474+0000) 2021-08-03T12:58:02.360 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:02.354+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:02.355731+0000) 2021-08-03T12:58:02.367 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:02.361+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:02.361811+0000) 2021-08-03T12:58:02.427 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:02.421+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:02.422544+0000) 2021-08-03T12:58:02.487 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:02.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:02.484081+0000) 2021-08-03T12:58:02.649 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:02.539+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3748 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:02.848 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:02.842+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:02.844396+0000) 2021-08-03T12:58:02.890 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:02.884+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:02.886337+0000) 2021-08-03T12:58:03.140 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:03.134+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.136000+0000) 2021-08-03T12:58:03.361 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:03.355+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.357033+0000) 2021-08-03T12:58:03.411 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:03.406+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.406817+0000) 2021-08-03T12:58:03.428 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:03.422+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.423188+0000) 2021-08-03T12:58:03.489 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:03.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.484231+0000) 2021-08-03T12:58:03.850 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:03.844+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.846635+0000) 2021-08-03T12:58:03.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:03.879+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.880634+0000) 2021-08-03T12:58:03.891 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:03.885+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:03.886942+0000) 2021-08-03T12:58:04.142 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:04.135+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.137210+0000) 2021-08-03T12:58:04.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:04.152+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.154098+0000) 2021-08-03T12:58:04.172 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:04.010+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9302 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:04.362 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:04.355+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.357599+0000) 2021-08-03T12:58:04.412 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:04.406+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.407430+0000) 2021-08-03T12:58:04.428 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:04.423+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.424176+0000) 2021-08-03T12:58:04.487 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:04.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.484381+0000) 2021-08-03T12:58:04.852 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:04.847+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.849018+0000) 2021-08-03T12:58:04.891 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:04.885+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.887518+0000) 2021-08-03T12:58:04.904 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:04.899+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:04.899853+0000) 2021-08-03T12:58:05.142 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:05.136+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:05.137766+0000) 2021-08-03T12:58:05.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:05.152+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:05.154237+0000) 2021-08-03T12:58:05.362 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:05.356+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:05.358362+0000) 2021-08-03T12:58:05.412 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:05.407+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:05.408250+0000) 2021-08-03T12:58:05.428 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:05.423+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:05.424763+0000) 2021-08-03T12:58:05.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:05.482+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:05.484529+0000) 2021-08-03T12:58:05.892 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:05.887+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:05.888089+0000) 2021-08-03T12:58:06.143 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:06.137+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:06.138688+0000) 2021-08-03T12:58:06.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:06.153+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:06.154386+0000) 2021-08-03T12:58:06.363 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:06.358+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:06.358922+0000) 2021-08-03T12:58:06.389 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:06.200+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8871 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:06.413 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:06.408+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:06.408964+0000) 2021-08-03T12:58:06.429 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:06.424+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:06.425357+0000) 2021-08-03T12:58:06.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:06.483+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:06.484651+0000) 2021-08-03T12:58:06.892 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:06.887+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:06.888645+0000) 2021-08-03T12:58:07.143 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:07.138+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:07.139269+0000) 2021-08-03T12:58:07.363 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:07.358+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:07.359493+0000) 2021-08-03T12:58:07.413 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:07.408+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:07.409546+0000) 2021-08-03T12:58:07.430 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:07.425+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:07.426398+0000) 2021-08-03T12:58:07.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:07.483+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:07.484780+0000) 2021-08-03T12:58:07.894 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:07.889+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:07.889741+0000) 2021-08-03T12:58:08.144 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:08.139+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:08.139838+0000) 2021-08-03T12:58:08.364 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:08.359+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:08.360069+0000) 2021-08-03T12:58:08.414 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:08.409+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:08.410159+0000) 2021-08-03T12:58:08.431 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:08.426+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:08.427465+0000) 2021-08-03T12:58:08.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:08.484+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:08.484957+0000) 2021-08-03T12:58:08.895 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:08.889+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:08.890501+0000) 2021-08-03T12:58:09.144 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:09.139+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:09.140416+0000) 2021-08-03T12:58:09.201 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:09.195+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3749 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:09.365 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:09.359+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:09.360634+0000) 2021-08-03T12:58:09.415 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:09.409+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:09.410740+0000) 2021-08-03T12:58:09.432 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:09.427+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:09.428283+0000) 2021-08-03T12:58:09.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:09.484+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:09.485108+0000) 2021-08-03T12:58:09.691 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:09.687+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:09.688159+0000) 2021-08-03T12:58:09.897 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:09.890+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:09.891248+0000) 2021-08-03T12:58:10.145 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:10.140+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:10.141002+0000) 2021-08-03T12:58:10.366 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:10.360+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:10.361242+0000) 2021-08-03T12:58:10.415 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:10.410+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:10.411333+0000) 2021-08-03T12:58:10.433 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:10.428+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:10.428874+0000) 2021-08-03T12:58:11.146 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:11.140+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:11.141601+0000) 2021-08-03T12:58:11.416 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:11.411+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:11.411925+0000) 2021-08-03T12:58:11.438 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:11.429+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:11.429746+0000) 2021-08-03T12:58:11.768 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:11.227+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:12.146 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:12.141+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:12.142112+0000) 2021-08-03T12:58:12.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:12.402+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:12.403559+0000) 2021-08-03T12:58:12.416 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:12.411+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:12.412519+0000) 2021-08-03T12:58:12.423 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:12.079+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8878 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:12.604 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:12.600+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:12.600878+0000) 2021-08-03T12:58:13.147 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:13.141+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:13.142647+0000) 2021-08-03T12:58:13.278 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:13.273+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:13.274256+0000) 2021-08-03T12:58:13.607 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:13.602+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:13.603200+0000) 2021-08-03T12:58:13.715 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:13.709+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:13.710366+0000) 2021-08-03T12:58:13.908 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:13.904+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:13.904811+0000) 2021-08-03T12:58:14.147 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:14.142+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:14.143420+0000) 2021-08-03T12:58:14.432 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:14.426+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:14.427518+0000) 2021-08-03T12:58:14.477 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:14.471+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:14.472113+0000) 2021-08-03T12:58:14.611 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:14.606+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:14.607541+0000) 2021-08-03T12:58:14.908 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:14.904+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:14.904950+0000) 2021-08-03T12:58:15.091 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:15.086+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:15.086750+0000) 2021-08-03T12:58:15.150 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:15.143+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:15.143927+0000) 2021-08-03T12:58:15.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:15.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:15.609103+0000) 2021-08-03T12:58:15.825 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:15.820+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:15.821376+0000) 2021-08-03T12:58:15.854 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:15.850+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:15.851339+0000) 2021-08-03T12:58:15.908 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:15.904+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:15.905063+0000) 2021-08-03T12:58:16.091 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:16.086+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:16.087506+0000) 2021-08-03T12:58:16.134 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:16.128+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:16.129350+0000) 2021-08-03T12:58:16.157 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:16.057+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3751 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:16.494 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:16.488+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:16.490322+0000) 2021-08-03T12:58:16.531 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:16.525+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:16.526551+0000) 2021-08-03T12:58:16.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:16.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:16.609295+0000) 2021-08-03T12:58:16.826 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:16.821+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:16.822356+0000) 2021-08-03T12:58:16.908 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:16.904+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:16.905214+0000) 2021-08-03T12:58:17.092 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:17.087+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:17.088136+0000) 2021-08-03T12:58:17.298 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:17.291+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:17.293258+0000) 2021-08-03T12:58:17.507 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:17.499+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:17.501539+0000) 2021-08-03T12:58:17.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:17.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:17.609428+0000) 2021-08-03T12:58:17.827 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:17.822+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:17.822930+0000) 2021-08-03T12:58:17.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:17.904+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:17.905341+0000) 2021-08-03T12:58:18.093 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:18.088+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:18.088716+0000) 2021-08-03T12:58:18.271 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:18.264+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:18.266466+0000) 2021-08-03T12:58:18.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:18.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:18.609723+0000) 2021-08-03T12:58:18.775 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:18.169+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:18.827 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:18.822+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:18.823525+0000) 2021-08-03T12:58:18.865 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:18.859+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:18.861031+0000) 2021-08-03T12:58:18.909 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:18.904+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:18.905498+0000) 2021-08-03T12:58:18.923 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:18.919+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:18.920253+0000) 2021-08-03T12:58:19.094 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:19.088+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:19.089550+0000) 2021-08-03T12:58:19.260 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:19.254+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:19.255547+0000) 2021-08-03T12:58:19.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:19.609+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:19.609847+0000) 2021-08-03T12:58:19.828 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:19.823+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:19.824101+0000) 2021-08-03T12:58:19.866 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:19.860+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:19.861829+0000) 2021-08-03T12:58:19.924 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:19.919+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:19.920393+0000) 2021-08-03T12:58:19.978 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:19.954+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8878 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:20.094 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:20.089+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:20.090162+0000) 2021-08-03T12:58:20.327 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:20.321+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:20.323190+0000) 2021-08-03T12:58:20.867 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:20.860+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:20.862734+0000) 2021-08-03T12:58:20.924 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:20.919+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:20.920510+0000) 2021-08-03T12:58:21.095 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:21.089+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:21.090705+0000) 2021-08-03T12:58:21.328 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:21.322+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:21.324340+0000) 2021-08-03T12:58:21.868 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:21.861+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:21.863646+0000) 2021-08-03T12:58:21.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:21.969+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:21.970553+0000) 2021-08-03T12:58:22.095 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:22.090+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:22.091296+0000) 2021-08-03T12:58:22.266 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:22.171+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3753 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:22.330 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:22.323+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:22.325557+0000) 2021-08-03T12:58:22.592 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:22.586+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:22.588518+0000) 2021-08-03T12:58:22.822 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:22.817+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:22.818676+0000) 2021-08-03T12:58:22.868 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:22.862+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:22.864433+0000) 2021-08-03T12:58:22.876 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:22.870+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:22.870771+0000) 2021-08-03T12:58:23.097 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:23.091+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:23.092471+0000) 2021-08-03T12:58:23.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:23.282+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:23.284789+0000) 2021-08-03T12:58:23.331 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:23.325+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:23.326883+0000) 2021-08-03T12:58:23.822 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:23.818+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:23.818859+0000) 2021-08-03T12:58:23.869 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:23.863+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:23.864985+0000) 2021-08-03T12:58:24.097 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:24.092+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:24.093071+0000) 2021-08-03T12:58:24.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:24.284+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:24.284909+0000) 2021-08-03T12:58:24.333 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:24.328+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:24.328387+0000) 2021-08-03T12:58:24.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:24.429+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:24.430032+0000) 2021-08-03T12:58:24.822 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:24.818+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:24.819004+0000) 2021-08-03T12:58:24.869 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:24.864+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:24.865559+0000) 2021-08-03T12:58:25.098 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:25.092+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:25.093620+0000) 2021-08-03T12:58:25.211 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:25.207+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:25.208122+0000) 2021-08-03T12:58:25.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:25.284+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:25.285032+0000) 2021-08-03T12:58:25.334 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:25.329+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:25.330391+0000) 2021-08-03T12:58:25.428 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:25.422+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:25.423614+0000) 2021-08-03T12:58:25.822 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:25.818+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:25.819124+0000) 2021-08-03T12:58:25.855 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:25.722+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:25.870 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:25.865+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:25.866131+0000) 2021-08-03T12:58:26.098 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:26.093+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.094323+0000) 2021-08-03T12:58:26.261 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:26.239+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8878 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:26.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:26.284+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.285138+0000) 2021-08-03T12:58:26.335 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:26.330+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.331358+0000) 2021-08-03T12:58:26.379 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:26.372+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.373098+0000) 2021-08-03T12:58:26.397 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:26.391+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.392392+0000) 2021-08-03T12:58:26.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:26.655+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.655944+0000) 2021-08-03T12:58:26.700 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:26.694+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.695452+0000) 2021-08-03T12:58:26.880 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:26.866+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:26.867545+0000) 2021-08-03T12:58:27.099 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:27.094+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:27.094912+0000) 2021-08-03T12:58:27.226 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:27.222+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:27.222919+0000) 2021-08-03T12:58:27.230 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:27.224+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:27.225064+0000) 2021-08-03T12:58:27.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:27.284+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:27.285265+0000) 2021-08-03T12:58:27.336 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:27.332+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:27.332882+0000) 2021-08-03T12:58:27.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:27.359+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:27.360493+0000) 2021-08-03T12:58:27.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:27.655+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:27.656066+0000) 2021-08-03T12:58:28.099 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:28.094+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:28.095302+0000) 2021-08-03T12:58:28.112 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:28.108+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:28.109283+0000) 2021-08-03T12:58:28.288 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:28.284+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:28.285413+0000) 2021-08-03T12:58:28.338 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:28.333+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:28.333816+0000) 2021-08-03T12:58:28.366 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:28.362+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:28.363056+0000) 2021-08-03T12:58:28.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:28.655+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:28.656227+0000) 2021-08-03T12:58:28.726 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:28.720+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:28.721291+0000) 2021-08-03T12:58:29.100 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:29.095+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:29.095917+0000) 2021-08-03T12:58:29.289 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:29.284+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:29.285552+0000) 2021-08-03T12:58:29.303 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:29.298+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:29.299191+0000) 2021-08-03T12:58:29.369 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:29.364+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:29.365798+0000) 2021-08-03T12:58:29.660 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:29.655+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:29.656380+0000) 2021-08-03T12:58:29.723 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:29.718+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:29.719092+0000) 2021-08-03T12:58:29.972 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:29.967+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:29.968096+0000) 2021-08-03T12:58:30.101 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:30.095+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:30.096524+0000) 2021-08-03T12:58:30.289 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:30.284+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:30.285681+0000) 2021-08-03T12:58:30.302 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:30.297+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:30.298385+0000) 2021-08-03T12:58:30.371 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:30.367+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:30.368015+0000) 2021-08-03T12:58:30.660 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:30.655+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:30.656531+0000) 2021-08-03T12:58:30.686 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:30.616+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3757 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:30.724 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:30.719+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:30.720137+0000) 2021-08-03T12:58:30.973 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:30.968+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:30.968841+0000) 2021-08-03T12:58:31.101 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:31.096+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:31.097127+0000) 2021-08-03T12:58:31.303 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:31.298+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:31.299132+0000) 2021-08-03T12:58:31.371 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:31.367+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:31.368231+0000) 2021-08-03T12:58:31.725 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:31.719+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:31.720712+0000) 2021-08-03T12:58:31.914 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:31.909+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:31.910126+0000) 2021-08-03T12:58:31.974 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:31.968+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:31.969488+0000) 2021-08-03T12:58:32.102 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:32.097+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:32.097780+0000) 2021-08-03T12:58:32.304 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:32.299+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:32.299938+0000) 2021-08-03T12:58:32.372 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:32.367+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:32.368386+0000) 2021-08-03T12:58:32.602 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:32.596+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:32.714 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:32.707+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:32.708667+0000) 2021-08-03T12:58:32.725 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:32.720+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:32.721301+0000) 2021-08-03T12:58:32.915 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:32.910+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:32.910945+0000) 2021-08-03T12:58:33.076 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:33.068+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8893 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:33.596 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:33.591+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:33.592241+0000) 2021-08-03T12:58:33.726 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:33.721+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:33.721920+0000) 2021-08-03T12:58:33.915 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:33.910+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:33.911561+0000) 2021-08-03T12:58:34.597 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:34.592+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:34.592913+0000) 2021-08-03T12:58:34.726 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:34.721+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:34.722519+0000) 2021-08-03T12:58:34.916 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:34.911+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:34.912396+0000) 2021-08-03T12:58:35.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:35.253+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:35.254248+0000) 2021-08-03T12:58:35.598 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:35.593+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:35.593875+0000) 2021-08-03T12:58:35.727 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:35.722+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:35.723115+0000) 2021-08-03T12:58:35.867 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:35.863+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:35.864197+0000) 2021-08-03T12:58:35.917 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:35.912+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:35.913064+0000) 2021-08-03T12:58:36.184 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:36.180+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:36.181217+0000) 2021-08-03T12:58:36.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:36.253+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:36.254442+0000) 2021-08-03T12:58:36.599 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:36.593+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:36.594625+0000) 2021-08-03T12:58:36.728 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:36.722+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:36.723658+0000) 2021-08-03T12:58:37.018 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:36.963+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3763 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:37.019 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:37.014+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:37.014842+0000) 2021-08-03T12:58:37.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:37.253+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:37.254574+0000) 2021-08-03T12:58:37.599 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:37.594+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:37.595431+0000) 2021-08-03T12:58:37.728 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:37.723+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:37.724286+0000) 2021-08-03T12:58:37.850 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:37.846+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:37.847045+0000) 2021-08-03T12:58:38.066 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:38.059+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:38.060664+0000) 2021-08-03T12:58:38.235 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:38.229+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:38.230540+0000) 2021-08-03T12:58:38.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:38.253+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:38.254686+0000) 2021-08-03T12:58:38.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:38.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:38.406945+0000) 2021-08-03T12:58:38.600 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:38.595+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:38.596005+0000) 2021-08-03T12:58:38.676 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:38.671+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:38.671996+0000) 2021-08-03T12:58:38.729 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:38.724+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:38.724895+0000) 2021-08-03T12:58:39.235 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:39.230+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:39.231273+0000) 2021-08-03T12:58:39.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:39.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:39.254834+0000) 2021-08-03T12:58:39.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:39.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:39.407091+0000) 2021-08-03T12:58:39.544 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:39.537+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:39.538673+0000) 2021-08-03T12:58:39.600 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:39.595+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:39.596583+0000) 2021-08-03T12:58:39.776 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:39.595+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:39.906 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:39.877+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8895 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:40.122 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:40.118+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:40.118868+0000) 2021-08-03T12:58:40.156 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:40.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:40.152903+0000) 2021-08-03T12:58:40.237 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:40.231+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:40.232507+0000) 2021-08-03T12:58:40.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:40.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:40.254944+0000) 2021-08-03T12:58:40.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:40.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:40.407260+0000) 2021-08-03T12:58:40.601 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:40.596+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:40.597314+0000) 2021-08-03T12:58:41.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:41.120+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:41.121241+0000) 2021-08-03T12:58:41.156 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:41.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:41.153047+0000) 2021-08-03T12:58:41.238 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:41.232+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:41.233363+0000) 2021-08-03T12:58:41.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:41.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:41.255068+0000) 2021-08-03T12:58:41.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:41.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:41.407442+0000) 2021-08-03T12:58:41.602 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:41.597+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:41.598312+0000) 2021-08-03T12:58:41.870 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:41.865+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:41.866376+0000) 2021-08-03T12:58:42.127 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:42.123+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:42.123861+0000) 2021-08-03T12:58:42.156 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:42.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:42.153203+0000) 2021-08-03T12:58:42.238 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:42.233+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:42.234179+0000) 2021-08-03T12:58:42.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:42.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:42.255200+0000) 2021-08-03T12:58:42.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:42.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:42.407591+0000) 2021-08-03T12:58:42.603 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:42.598+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:42.598893+0000) 2021-08-03T12:58:42.872 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:42.866+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:42.867311+0000) 2021-08-03T12:58:43.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:43.124+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.125494+0000) 2021-08-03T12:58:43.156 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:43.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.153314+0000) 2021-08-03T12:58:43.239 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:43.233+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.234757+0000) 2021-08-03T12:58:43.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:43.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.255307+0000) 2021-08-03T12:58:43.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:43.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.407736+0000) 2021-08-03T12:58:43.434 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:43.429+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.430053+0000) 2021-08-03T12:58:43.604 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:43.598+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.599425+0000) 2021-08-03T12:58:43.872 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:43.867+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:43.868092+0000) 2021-08-03T12:58:44.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:44.124+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.125642+0000) 2021-08-03T12:58:44.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:44.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.153489+0000) 2021-08-03T12:58:44.240 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:44.234+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.235350+0000) 2021-08-03T12:58:44.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:44.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.255415+0000) 2021-08-03T12:58:44.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:44.407+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.407882+0000) 2021-08-03T12:58:44.434 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:44.427+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.428541+0000) 2021-08-03T12:58:44.435 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:44.430+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.430912+0000) 2021-08-03T12:58:44.604 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:44.599+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.600120+0000) 2021-08-03T12:58:44.873 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:44.867+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.868694+0000) 2021-08-03T12:58:44.886 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:44.880+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:44.881690+0000) 2021-08-03T12:58:44.959 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:44.861+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3778 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:45.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:45.124+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.125875+0000) 2021-08-03T12:58:45.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:45.151+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.153638+0000) 2021-08-03T12:58:45.240 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:45.235+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.235930+0000) 2021-08-03T12:58:45.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:45.253+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.255551+0000) 2021-08-03T12:58:45.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:45.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.408021+0000) 2021-08-03T12:58:45.436 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:45.430+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.431505+0000) 2021-08-03T12:58:45.605 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:45.598+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.600698+0000) 2021-08-03T12:58:45.873 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:45.867+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:45.869335+0000) 2021-08-03T12:58:46.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:46.124+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:46.125984+0000) 2021-08-03T12:58:46.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:46.151+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:46.153772+0000) 2021-08-03T12:58:46.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:46.253+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:46.255673+0000) 2021-08-03T12:58:46.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:46.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:46.408177+0000) 2021-08-03T12:58:46.436 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:46.431+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:46.432114+0000) 2021-08-03T12:58:46.605 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:46.599+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:46.601447+0000) 2021-08-03T12:58:46.698 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:46.586+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8907 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:46.874 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:46.868+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:46.869957+0000) 2021-08-03T12:58:47.077 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:46.804+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:47.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:47.124+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.126212+0000) 2021-08-03T12:58:47.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:47.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.153891+0000) 2021-08-03T12:58:47.253 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:47.249+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.250414+0000) 2021-08-03T12:58:47.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:47.253+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.255795+0000) 2021-08-03T12:58:47.407 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:47.401+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.402577+0000) 2021-08-03T12:58:47.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:47.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.408306+0000) 2021-08-03T12:58:47.437 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:47.432+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.433005+0000) 2021-08-03T12:58:47.607 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:47.600+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.602625+0000) 2021-08-03T12:58:47.670 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:47.664+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.665228+0000) 2021-08-03T12:58:47.875 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:47.868+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:47.870564+0000) 2021-08-03T12:58:48.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:48.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:48.154008+0000) 2021-08-03T12:58:48.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:48.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:48.255948+0000) 2021-08-03T12:58:48.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:48.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:48.408453+0000) 2021-08-03T12:58:48.438 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:48.432+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:48.433659+0000) 2021-08-03T12:58:48.608 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:48.601+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:48.603372+0000) 2021-08-03T12:58:48.875 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:48.869+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:48.871189+0000) 2021-08-03T12:58:48.920 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:48.915+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:48.917117+0000) 2021-08-03T12:58:49.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:49.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:49.154147+0000) 2021-08-03T12:58:49.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:49.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:49.256047+0000) 2021-08-03T12:58:49.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:49.406+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:49.408601+0000) 2021-08-03T12:58:49.439 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:49.433+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:49.434488+0000) 2021-08-03T12:58:49.608 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:49.602+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:49.603918+0000) 2021-08-03T12:58:49.876 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:49.870+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:49.871749+0000) 2021-08-03T12:58:50.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:50.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:50.154317+0000) 2021-08-03T12:58:50.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:50.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:50.256179+0000) 2021-08-03T12:58:50.543 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:50.535+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:50.537580+0000) 2021-08-03T12:58:50.608 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:50.602+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:50.604387+0000) 2021-08-03T12:58:50.658 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:50.330+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3784 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:50.872 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:50.863+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:50.865387+0000) 2021-08-03T12:58:51.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:51.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:51.154482+0000) 2021-08-03T12:58:51.198 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:51.193+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:51.194038+0000) 2021-08-03T12:58:51.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:51.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:51.256340+0000) 2021-08-03T12:58:51.609 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:51.603+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:51.604927+0000) 2021-08-03T12:58:51.718 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:51.712+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:51.714351+0000) 2021-08-03T12:58:51.727 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:51.720+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:51.721442+0000) 2021-08-03T12:58:52.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:52.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:52.154636+0000) 2021-08-03T12:58:52.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:52.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:52.256468+0000) 2021-08-03T12:58:52.609 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:52.603+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:52.605664+0000) 2021-08-03T12:58:52.660 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:52.526+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:52.885 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:52.878+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:52.879247+0000) 2021-08-03T12:58:52.886 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:52.881+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:52.883277+0000) 2021-08-03T12:58:52.970 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:58:52.966+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:52.967114+0000) 2021-08-03T12:58:53.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:53.152+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:53.154781+0000) 2021-08-03T12:58:53.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:53.254+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:53.256586+0000) 2021-08-03T12:58:53.367 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:58:53.360+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:53.362081+0000) 2021-08-03T12:58:53.457 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:58:53.451+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8909 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:58:53.611 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:53.604+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:53.606568+0000) 2021-08-03T12:58:54.034 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:58:54.028+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.029717+0000) 2021-08-03T12:58:54.142 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:54.136+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.136833+0000) 2021-08-03T12:58:54.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:54.154+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.154949+0000) 2021-08-03T12:58:54.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:54.255+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.256722+0000) 2021-08-03T12:58:54.333 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:54.325+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.326559+0000) 2021-08-03T12:58:54.611 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:54.606+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.607261+0000) 2021-08-03T12:58:54.816 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:58:54.810+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.811636+0000) 2021-08-03T12:58:54.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:54.875+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:54.876617+0000) 2021-08-03T12:58:55.136 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:55.130+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:55.131455+0000) 2021-08-03T12:58:55.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:55.154+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:55.155112+0000) 2021-08-03T12:58:55.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:55.256+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:55.256865+0000) 2021-08-03T12:58:55.405 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:55.401+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:55.402038+0000) 2021-08-03T12:58:55.458 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:58:55.334+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3787 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:58:55.612 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:55.607+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:55.607820+0000) 2021-08-03T12:58:55.727 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:58:55.721+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:55.722301+0000) 2021-08-03T12:58:55.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:55.878+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:55.879108+0000) 2021-08-03T12:58:56.136 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:56.131+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:56.132212+0000) 2021-08-03T12:58:56.159 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:56.154+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:56.155278+0000) 2021-08-03T12:58:56.613 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:56.607+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:56.608716+0000) 2021-08-03T12:58:56.886 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:56.882+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:56.883107+0000) 2021-08-03T12:58:56.924 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:56.919+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:56.920381+0000) 2021-08-03T12:58:57.137 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:57.132+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:57.133001+0000) 2021-08-03T12:58:57.159 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:57.154+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:57.155410+0000) 2021-08-03T12:58:57.162 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:57.158+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:57.158969+0000) 2021-08-03T12:58:57.613 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:57.608+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:57.609308+0000) 2021-08-03T12:58:57.885 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:58:57.879+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:57.880677+0000) 2021-08-03T12:58:57.889 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:57.885+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:57.885859+0000) 2021-08-03T12:58:57.925 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:58:57.920+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:57.921128+0000) 2021-08-03T12:58:58.138 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:58:58.132+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:58.133606+0000) 2021-08-03T12:58:58.159 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:58.154+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:58.155552+0000) 2021-08-03T12:58:58.162 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:58.158+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:58.159092+0000) 2021-08-03T12:58:58.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:58.385+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:58.386385+0000) 2021-08-03T12:58:58.614 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:58.609+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:58.609877+0000) 2021-08-03T12:58:58.724 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:58:58.717+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:58:59.159 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:59.154+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:59.155721+0000) 2021-08-03T12:58:59.162 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:58:59.158+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:59.159205+0000) 2021-08-03T12:58:59.615 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:58:59.609+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:58:59.610447+0000) 2021-08-03T12:59:00.159 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:00.155+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:00.155864+0000) 2021-08-03T12:59:00.162 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:00.158+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:00.159354+0000) 2021-08-03T12:59:00.834 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:00.802+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8934 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:01.163 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:01.158+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:01.159503+0000) 2021-08-03T12:59:01.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:01.182+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:01.183042+0000) 2021-08-03T12:59:01.289 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:01.285+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:01.286148+0000) 2021-08-03T12:59:01.317 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:00.617+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3794 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:02.163 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:02.158+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:02.159646+0000) 2021-08-03T12:59:02.289 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:02.285+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:02.286305+0000) 2021-08-03T12:59:02.619 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:02.613+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:02.614054+0000) 2021-08-03T12:59:03.290 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:03.285+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:03.286459+0000) 2021-08-03T12:59:03.309 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:03.305+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:03.305840+0000) 2021-08-03T12:59:03.313 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:03.306+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:03.307717+0000) 2021-08-03T12:59:03.612 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:03.606+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:03.607219+0000) 2021-08-03T12:59:03.843 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:03.791+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9317 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:04.147 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:04.142+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:04.143451+0000) 2021-08-03T12:59:04.290 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:04.285+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:04.286587+0000) 2021-08-03T12:59:05.078 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:05.071+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:05.072765+0000) 2021-08-03T12:59:05.290 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:05.285+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:05.286736+0000) 2021-08-03T12:59:05.362 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:05.356+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:05.357070+0000) 2021-08-03T12:59:05.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:05.635+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:05.636428+0000) 2021-08-03T12:59:06.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:06.081+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:06.082043+0000) 2021-08-03T12:59:06.139 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:06.131+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:06.132075+0000) 2021-08-03T12:59:06.290 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:06.286+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:06.286899+0000) 2021-08-03T12:59:06.527 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:06.522+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:06.523076+0000) 2021-08-03T12:59:06.642 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:06.638+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:06.638925+0000) 2021-08-03T12:59:06.961 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:06.950+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8955 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:07.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:07.081+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:07.082173+0000) 2021-08-03T12:59:07.168 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:59:07.163+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:07.163981+0000) 2021-08-03T12:59:07.290 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:07.286+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:07.287037+0000) 2021-08-03T12:59:07.646 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:07.641+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:07.642215+0000) 2021-08-03T12:59:07.697 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:07.692+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:07.693395+0000) 2021-08-03T12:59:08.033 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:08.028+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:08.029344+0000) 2021-08-03T12:59:08.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:08.081+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:08.082290+0000) 2021-08-03T12:59:08.290 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:08.286+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:08.287165+0000) 2021-08-03T12:59:08.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:08.643+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:08.643861+0000) 2021-08-03T12:59:09.034 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:09.029+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:09.030061+0000) 2021-08-03T12:59:09.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:09.081+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:09.082409+0000) 2021-08-03T12:59:09.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:09.286+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:09.287311+0000) 2021-08-03T12:59:09.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:09.643+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:09.644018+0000) 2021-08-03T12:59:09.663 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:09.657+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:09.657814+0000) 2021-08-03T12:59:09.913 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:09.909+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:09.910031+0000) 2021-08-03T12:59:10.035 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:10.029+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:10.030646+0000) 2021-08-03T12:59:10.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:10.081+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:10.082544+0000) 2021-08-03T12:59:10.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:10.286+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:10.287455+0000) 2021-08-03T12:59:10.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:10.643+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:10.644257+0000) 2021-08-03T12:59:10.913 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:10.909+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:10.910167+0000) 2021-08-03T12:59:11.035 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:11.030+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:11.031258+0000) 2021-08-03T12:59:11.076 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:11.071+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:11.072338+0000) 2021-08-03T12:59:11.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:11.081+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:11.082708+0000) 2021-08-03T12:59:11.181 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:10.659+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3795 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:11.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:11.286+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:11.287617+0000) 2021-08-03T12:59:11.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:11.643+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:11.644379+0000) 2021-08-03T12:59:11.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:11.909+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:11.910328+0000) 2021-08-03T12:59:12.036 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:12.031+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:12.032093+0000) 2021-08-03T12:59:12.076 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:12.071+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:12.072487+0000) 2021-08-03T12:59:12.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:12.082+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:12.082825+0000) 2021-08-03T12:59:12.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:12.286+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:12.287769+0000) 2021-08-03T12:59:12.644 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:12.467+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9340 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:12.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:12.643+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:12.644582+0000) 2021-08-03T12:59:12.850 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:12.845+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:12.846228+0000) 2021-08-03T12:59:12.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:12.909+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:12.910461+0000) 2021-08-03T12:59:13.037 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:13.032+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.032944+0000) 2021-08-03T12:59:13.076 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:13.071+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.072620+0000) 2021-08-03T12:59:13.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:13.082+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.082923+0000) 2021-08-03T12:59:13.109 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:13.104+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.105047+0000) 2021-08-03T12:59:13.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:13.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.287896+0000) 2021-08-03T12:59:13.619 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:13.608+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.609359+0000) 2021-08-03T12:59:13.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:13.643+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.644714+0000) 2021-08-03T12:59:13.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:13.909+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:13.910582+0000) 2021-08-03T12:59:14.038 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:14.033+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:14.033800+0000) 2021-08-03T12:59:14.076 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:14.071+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:14.072757+0000) 2021-08-03T12:59:14.081 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:14.058+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8955 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:14.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:14.082+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:14.083044+0000) 2021-08-03T12:59:14.109 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:14.104+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:14.105715+0000) 2021-08-03T12:59:14.262 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:14.257+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:14.258101+0000) 2021-08-03T12:59:14.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:14.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:14.288019+0000) 2021-08-03T12:59:14.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:14.909+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:14.910717+0000) 2021-08-03T12:59:15.038 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:15.033+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:15.034620+0000) 2021-08-03T12:59:15.076 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:15.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:15.072911+0000) 2021-08-03T12:59:15.110 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:15.105+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:15.106261+0000) 2021-08-03T12:59:15.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:15.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:15.288147+0000) 2021-08-03T12:59:15.341 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:59:15.335+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:15.336230+0000) 2021-08-03T12:59:15.763 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:15.758+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:15.758941+0000) 2021-08-03T12:59:15.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:15.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:15.910851+0000) 2021-08-03T12:59:16.039 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:16.034+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.035436+0000) 2021-08-03T12:59:16.076 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:16.072+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.073062+0000) 2021-08-03T12:59:16.111 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:16.106+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.106852+0000) 2021-08-03T12:59:16.227 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:16.222+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.222834+0000) 2021-08-03T12:59:16.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:16.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.288291+0000) 2021-08-03T12:59:16.419 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:15.956+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3795 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:16.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:16.467+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.468103+0000) 2021-08-03T12:59:16.764 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:16.759+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.759956+0000) 2021-08-03T12:59:16.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:16.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:16.910961+0000) 2021-08-03T12:59:17.006 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:17.001+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:17.001819+0000) 2021-08-03T12:59:17.291 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:17.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:17.288426+0000) 2021-08-03T12:59:17.498 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:17.493+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:17.493758+0000) 2021-08-03T12:59:17.765 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:17.759+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:17.760553+0000) 2021-08-03T12:59:17.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:17.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:17.911108+0000) 2021-08-03T12:59:18.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:18.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:18.288583+0000) 2021-08-03T12:59:18.451 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:18.444+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:18.445653+0000) 2021-08-03T12:59:18.499 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:18.493+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:18.494696+0000) 2021-08-03T12:59:18.648 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:18.642+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:18.643575+0000) 2021-08-03T12:59:18.765 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:18.760+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:18.761180+0000) 2021-08-03T12:59:18.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:18.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:18.911236+0000) 2021-08-03T12:59:18.931 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:18.926+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:18.926992+0000) 2021-08-03T12:59:19.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:19.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:19.288733+0000) 2021-08-03T12:59:19.469 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:19.461+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8955 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:19.499 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:19.494+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:19.495495+0000) 2021-08-03T12:59:19.722 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:19.686+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9355 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:19.766 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:19.761+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:19.762156+0000) 2021-08-03T12:59:19.914 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:19.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:19.911393+0000) 2021-08-03T12:59:20.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:20.287+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:20.288860+0000) 2021-08-03T12:59:20.500 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:20.495+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:20.496069+0000) 2021-08-03T12:59:20.505 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:20.500+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:20.501551+0000) 2021-08-03T12:59:20.767 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:20.761+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:20.762725+0000) 2021-08-03T12:59:20.915 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:20.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:20.911512+0000) 2021-08-03T12:59:21.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:21.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:21.288996+0000) 2021-08-03T12:59:21.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:21.394+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:21.395275+0000) 2021-08-03T12:59:21.767 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:21.762+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:21.763318+0000) 2021-08-03T12:59:21.915 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:21.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:21.911640+0000) 2021-08-03T12:59:22.163 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:22.157+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:22.158470+0000) 2021-08-03T12:59:22.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:22.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:22.289181+0000) 2021-08-03T12:59:22.313 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:22.307+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:22.308363+0000) 2021-08-03T12:59:22.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:22.397+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:22.398126+0000) 2021-08-03T12:59:22.768 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:22.763+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:22.764202+0000) 2021-08-03T12:59:22.915 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:22.910+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:22.911749+0000) 2021-08-03T12:59:23.110 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:23.105+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:23.106329+0000) 2021-08-03T12:59:23.292 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:23.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:23.289341+0000) 2021-08-03T12:59:23.404 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:23.399+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:23.400758+0000) 2021-08-03T12:59:23.535 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:23.530+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:23.531742+0000) 2021-08-03T12:59:23.570 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:23.564+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:23.565452+0000) 2021-08-03T12:59:23.769 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:23.763+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:23.764790+0000) 2021-08-03T12:59:23.915 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:23.911+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:23.911912+0000) 2021-08-03T12:59:24.111 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:24.106+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:24.106861+0000) 2021-08-03T12:59:24.188 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:24.182+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:24.183085+0000) 2021-08-03T12:59:24.260 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:23.820+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3797 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:24.293 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:24.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:24.289500+0000) 2021-08-03T12:59:24.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:24.401+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:24.402473+0000) 2021-08-03T12:59:24.769 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:24.764+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:24.765373+0000) 2021-08-03T12:59:25.112 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:25.106+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:25.107466+0000) 2021-08-03T12:59:25.293 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:25.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:25.289655+0000) 2021-08-03T12:59:25.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:25.401+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:25.402696+0000) 2021-08-03T12:59:25.771 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:25.765+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:25.766249+0000) 2021-08-03T12:59:25.908 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:59:25.902+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:25.903215+0000) 2021-08-03T12:59:25.933 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:25.928+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:25.929597+0000) 2021-08-03T12:59:25.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:25.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:25.962320+0000) 2021-08-03T12:59:26.112 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:26.107+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:26.108272+0000) 2021-08-03T12:59:26.293 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:26.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:26.289811+0000) 2021-08-03T12:59:26.354 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:26.349+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:26.350321+0000) 2021-08-03T12:59:26.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:26.402+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:26.402844+0000) 2021-08-03T12:59:26.728 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:26.702+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8955 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:26.736 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:26.713+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9396 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:26.771 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:26.765+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:26.767228+0000) 2021-08-03T12:59:26.836 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:26.832+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:26.832942+0000) 2021-08-03T12:59:26.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:26.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:26.962482+0000) 2021-08-03T12:59:27.294 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:27.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:27.289979+0000) 2021-08-03T12:59:27.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:27.402+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:27.403042+0000) 2021-08-03T12:59:27.596 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:27.590+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:27.591319+0000) 2021-08-03T12:59:27.772 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:27.766+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:27.767999+0000) 2021-08-03T12:59:27.812 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:27.805+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:27.806795+0000) 2021-08-03T12:59:27.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:27.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:27.962620+0000) 2021-08-03T12:59:28.293 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:28.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:28.290154+0000) 2021-08-03T12:59:28.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:28.402+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:28.403186+0000) 2021-08-03T12:59:28.528 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:59:28.522+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:28.522895+0000) 2021-08-03T12:59:28.775 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:28.768+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:28.769903+0000) 2021-08-03T12:59:28.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:28.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:28.962771+0000) 2021-08-03T12:59:29.088 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:29.082+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:29.082845+0000) 2021-08-03T12:59:29.294 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:29.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:29.290324+0000) 2021-08-03T12:59:29.403 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:29.396+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:29.398596+0000) 2021-08-03T12:59:29.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:29.402+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:29.403394+0000) 2021-08-03T12:59:29.775 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:29.769+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:29.770937+0000) 2021-08-03T12:59:29.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:29.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:29.962943+0000) 2021-08-03T12:59:30.294 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:30.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:30.290484+0000) 2021-08-03T12:59:30.314 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:30.308+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:30.309250+0000) 2021-08-03T12:59:30.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:30.402+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:30.403567+0000) 2021-08-03T12:59:30.450 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:30.445+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:30.445991+0000) 2021-08-03T12:59:30.776 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:30.769+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:30.771748+0000) 2021-08-03T12:59:30.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:30.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:30.963090+0000) 2021-08-03T12:59:31.101 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:30.689+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3800 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:31.207 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:31.200+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.202184+0000) 2021-08-03T12:59:31.294 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:31.288+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.290650+0000) 2021-08-03T12:59:31.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:31.402+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.403782+0000) 2021-08-03T12:59:31.450 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:31.445+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.446552+0000) 2021-08-03T12:59:31.631 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:31.625+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.626527+0000) 2021-08-03T12:59:31.665 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:31.661+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.662259+0000) 2021-08-03T12:59:31.776 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:31.770+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.772341+0000) 2021-08-03T12:59:31.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:31.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:31.958721+0000) 2021-08-03T12:59:32.295 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:32.290+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.291496+0000) 2021-08-03T12:59:32.323 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:32.307+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8955 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:32.324 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:32.319+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.320289+0000) 2021-08-03T12:59:32.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:32.403+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.403877+0000) 2021-08-03T12:59:32.451 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:32.446+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.447180+0000) 2021-08-03T12:59:32.631 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:32.626+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.627498+0000) 2021-08-03T12:59:32.666 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:32.661+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.662422+0000) 2021-08-03T12:59:32.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:32.702+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.703919+0000) 2021-08-03T12:59:32.777 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:32.771+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.773139+0000) 2021-08-03T12:59:32.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:32.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:32.958880+0000) 2021-08-03T12:59:33.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:33.405+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:33.407332+0000) 2021-08-03T12:59:33.452 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:33.446+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:33.447798+0000) 2021-08-03T12:59:33.778 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:33.772+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:33.774182+0000) 2021-08-03T12:59:33.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:33.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:33.959011+0000) 2021-08-03T12:59:34.103 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:34.096+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:34.414 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:34.409+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:34.410919+0000) 2021-08-03T12:59:34.779 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:34.774+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:34.775132+0000) 2021-08-03T12:59:34.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:34.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:34.959122+0000) 2021-08-03T12:59:35.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:35.410+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:35.412467+0000) 2021-08-03T12:59:35.781 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:35.775+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:35.776429+0000) 2021-08-03T12:59:35.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:35.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:35.959231+0000) 2021-08-03T12:59:36.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:36.410+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:36.412671+0000) 2021-08-03T12:59:36.729 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:36.721+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:36.723424+0000) 2021-08-03T12:59:36.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:36.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:36.959399+0000) 2021-08-03T12:59:37.366 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:37.361+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:37.363092+0000) 2021-08-03T12:59:37.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:37.411+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:37.412840+0000) 2021-08-03T12:59:37.738 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:59:37.730+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:37.732614+0000) 2021-08-03T12:59:37.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:37.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:37.959542+0000) 2021-08-03T12:59:38.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:38.411+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:38.413046+0000) 2021-08-03T12:59:38.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:38.957+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:38.959689+0000) 2021-08-03T12:59:39.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:39.411+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:39.413176+0000) 2021-08-03T12:59:39.608 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:39.418+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8964 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:39.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:39.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:39.959817+0000) 2021-08-03T12:59:40.146 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:40.062+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3818 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:40.183 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:40.178+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:40.179824+0000) 2021-08-03T12:59:40.296 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:40.287+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:40.856 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:40.850+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:40.852336+0000) 2021-08-03T12:59:40.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:40.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:40.959949+0000) 2021-08-03T12:59:41.183 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:41.179+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:41.179927+0000) 2021-08-03T12:59:41.856 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:41.850+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:41.852495+0000) 2021-08-03T12:59:41.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:41.958+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:41.960057+0000) 2021-08-03T12:59:42.183 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:42.179+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:42.180064+0000) 2021-08-03T12:59:42.856 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:42.851+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:42.852615+0000) 2021-08-03T12:59:42.963 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:42.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:42.960202+0000) 2021-08-03T12:59:43.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:43.851+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:43.852763+0000) 2021-08-03T12:59:43.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:43.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:43.960319+0000) 2021-08-03T12:59:43.970 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:43.964+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:43.965751+0000) 2021-08-03T12:59:44.856 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:44.852+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:44.852920+0000) 2021-08-03T12:59:44.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:44.959+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:44.960427+0000) 2021-08-03T12:59:45.755 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:45.732+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8969 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:45.856 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:45.852+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:45.853076+0000) 2021-08-03T12:59:45.892 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:45.888+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:45.889046+0000) 2021-08-03T12:59:45.893 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:45.885+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3831 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:46.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:46.852+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:46.853262+0000) 2021-08-03T12:59:47.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:47.852+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:47.853409+0000) 2021-08-03T12:59:47.871 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:47.770+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:48.625 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:48.620+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:48.621290+0000) 2021-08-03T12:59:48.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:48.852+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:48.853594+0000) 2021-08-03T12:59:48.863 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:48.857+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:48.857860+0000) 2021-08-03T12:59:49.167 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:49.162+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:49.163467+0000) 2021-08-03T12:59:49.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:49.852+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:49.853785+0000) 2021-08-03T12:59:50.541 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:50.537+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:50.538034+0000) 2021-08-03T12:59:50.800 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:50.794+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:50.794855+0000) 2021-08-03T12:59:50.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:50.853+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:50.853899+0000) 2021-08-03T12:59:51.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:51.537+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:51.538190+0000) 2021-08-03T12:59:51.857 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:51.853+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:51.854104+0000) 2021-08-03T12:59:51.921 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:51.914+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:51.915423+0000) 2021-08-03T12:59:52.047 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:52.043+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:52.044062+0000) 2021-08-03T12:59:52.072 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:52.068+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:52.069354+0000) 2021-08-03T12:59:52.512 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T12:59:52.506+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3832 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T12:59:52.542 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:52.537+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:52.538350+0000) 2021-08-03T12:59:52.647 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T12:59:52.640+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:52.641628+0000) 2021-08-03T12:59:52.664 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:52.659+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:52.660146+0000) 2021-08-03T12:59:52.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:52.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:52.710823+0000) 2021-08-03T12:59:52.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:52.853+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:52.854222+0000) 2021-08-03T12:59:53.073 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:53.068+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:53.069491+0000) 2021-08-03T12:59:53.666 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:53.660+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:53.661535+0000) 2021-08-03T12:59:53.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:53.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:53.710927+0000) 2021-08-03T12:59:53.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:53.853+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:53.854342+0000) 2021-08-03T12:59:54.073 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:54.068+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:54.069648+0000) 2021-08-03T12:59:54.238 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:54.234+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:54.234955+0000) 2021-08-03T12:59:54.343 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T12:59:54.337+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:54.338600+0000) 2021-08-03T12:59:54.517 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T12:59:54.508+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T12:59:54.577 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T12:59:54.495+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8982 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T12:59:54.667 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:54.662+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:54.662778+0000) 2021-08-03T12:59:54.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:54.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:54.711061+0000) 2021-08-03T12:59:54.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:54.853+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:54.854510+0000) 2021-08-03T12:59:55.073 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:55.068+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:55.069779+0000) 2021-08-03T12:59:55.181 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:55.175+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:55.176016+0000) 2021-08-03T12:59:55.218 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T12:59:55.213+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:55.213875+0000) 2021-08-03T12:59:55.668 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:55.662+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:55.663557+0000) 2021-08-03T12:59:55.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:55.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:55.711183+0000) 2021-08-03T12:59:55.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:55.853+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:55.854674+0000) 2021-08-03T12:59:56.073 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:56.069+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:56.069921+0000) 2021-08-03T12:59:56.169 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T12:59:56.162+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:56.162839+0000) 2021-08-03T12:59:56.483 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:56.479+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:56.480152+0000) 2021-08-03T12:59:56.668 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:56.663+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:56.664144+0000) 2021-08-03T12:59:56.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:56.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:56.711316+0000) 2021-08-03T12:59:56.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:56.854+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:56.854854+0000) 2021-08-03T12:59:57.116 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:57.110+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:57.111625+0000) 2021-08-03T12:59:57.293 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:57.288+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:57.289161+0000) 2021-08-03T12:59:57.633 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T12:59:57.627+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:57.627894+0000) 2021-08-03T12:59:57.669 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:57.663+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:57.664729+0000) 2021-08-03T12:59:57.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:57.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:57.711450+0000) 2021-08-03T12:59:57.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:57.854+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:57.855020+0000) 2021-08-03T12:59:58.117 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:58.111+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:58.112668+0000) 2021-08-03T12:59:58.295 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:58.290+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:58.291694+0000) 2021-08-03T12:59:58.386 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:58.380+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:58.380905+0000) 2021-08-03T12:59:58.669 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:58.664+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:58.665311+0000) 2021-08-03T12:59:58.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:58.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:58.711593+0000) 2021-08-03T12:59:58.859 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:58.854+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:58.855165+0000) 2021-08-03T12:59:58.892 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:58.888+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:58.888859+0000) 2021-08-03T12:59:59.089 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T12:59:59.084+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:59.085691+0000) 2021-08-03T12:59:59.118 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T12:59:59.112+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:59.113456+0000) 2021-08-03T12:59:59.298 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:59.293+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:59.294254+0000) 2021-08-03T12:59:59.671 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T12:59:59.666+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:59.667396+0000) 2021-08-03T12:59:59.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:59.710+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:59.711742+0000) 2021-08-03T12:59:59.859 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T12:59:59.854+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:59.855352+0000) 2021-08-03T12:59:59.893 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T12:59:59.888+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T11:59:59.889410+0000) 2021-08-03T13:00:00.118 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:00:00.113+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:00.114059+0000) 2021-08-03T13:00:00.186 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:00.180+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:00.181154+0000) 2021-08-03T13:00:00.299 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:00.295+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:00.295917+0000) 2021-08-03T13:00:00.585 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:00.411+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3842 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:00.673 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:00.667+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:00.668238+0000) 2021-08-03T13:00:00.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:00.711+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:00.711871+0000) 2021-08-03T13:00:00.859 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:00.854+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:00.855507+0000) 2021-08-03T13:00:00.894 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:00.889+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:00.890197+0000) 2021-08-03T13:00:01.119 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:00:01.113+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:01.114669+0000) 2021-08-03T13:00:01.182 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:01.099+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 8996 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:01.300 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:01.295+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:01.296160+0000) 2021-08-03T13:00:01.674 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:01.668+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:01.669551+0000) 2021-08-03T13:00:01.840 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:01.835+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:01.836286+0000) 2021-08-03T13:00:01.859 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:01.854+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:01.855662+0000) 2021-08-03T13:00:01.895 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:01.890+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:01.890807+0000) 2021-08-03T13:00:01.903 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:01.895+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:02.119 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:00:02.114+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:02.115218+0000) 2021-08-03T13:00:02.300 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:02.295+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:02.296315+0000) 2021-08-03T13:00:02.859 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:02.855+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:02.855819+0000) 2021-08-03T13:00:02.947 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:02.942+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:02.943370+0000) 2021-08-03T13:00:03.426 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:00:03.419+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:03.420751+0000) 2021-08-03T13:00:03.566 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:03.562+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:03.563101+0000) 2021-08-03T13:00:03.667 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:03.663+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:03.663826+0000) 2021-08-03T13:00:03.859 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:03.855+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:03.855956+0000) 2021-08-03T13:00:04.655 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:00:04.649+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:04.650237+0000) 2021-08-03T13:00:04.667 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:04.663+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:04.663962+0000) 2021-08-03T13:00:04.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:04.855+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:04.856122+0000) 2021-08-03T13:00:05.450 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:05.444+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:05.444743+0000) 2021-08-03T13:00:05.667 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:05.663+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:05.664096+0000) 2021-08-03T13:00:05.859 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:05.855+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:05.856283+0000) 2021-08-03T13:00:05.963 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:05.958+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:05.959269+0000) 2021-08-03T13:00:06.668 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:06.663+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:06.664210+0000) 2021-08-03T13:00:06.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:06.855+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:06.856425+0000) 2021-08-03T13:00:06.963 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:06.958+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:06.959420+0000) 2021-08-03T13:00:07.668 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:07.663+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:07.664367+0000) 2021-08-03T13:00:07.740 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:07.715+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3845 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:07.795 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:07.790+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:07.791598+0000) 2021-08-03T13:00:07.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:07.855+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:07.856599+0000) 2021-08-03T13:00:07.963 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:07.958+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:07.959541+0000) 2021-08-03T13:00:08.164 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:08.157+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:08.158692+0000) 2021-08-03T13:00:08.466 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:08.461+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:08.462272+0000) 2021-08-03T13:00:08.468 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:00:08.463+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:08.463921+0000) 2021-08-03T13:00:08.647 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:08.187+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9022 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:08.668 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:08.663+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:08.664503+0000) 2021-08-03T13:00:08.797 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:08.791+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:08.792525+0000) 2021-08-03T13:00:08.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:08.855+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:08.856794+0000) 2021-08-03T13:00:08.963 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:08.958+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:08.959668+0000) 2021-08-03T13:00:09.421 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:09.290+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:09.466 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:09.461+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:09.462424+0000) 2021-08-03T13:00:09.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:09.856+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:09.856901+0000) 2021-08-03T13:00:09.936 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:09.930+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:09.931253+0000) 2021-08-03T13:00:10.466 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:10.461+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:10.462589+0000) 2021-08-03T13:00:10.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:10.856+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:10.857067+0000) 2021-08-03T13:00:10.895 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:10.890+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:10.891709+0000) 2021-08-03T13:00:11.466 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:11.461+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:11.462713+0000) 2021-08-03T13:00:12.466 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:12.462+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:12.462823+0000) 2021-08-03T13:00:12.806 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:12.800+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:12.800918+0000) 2021-08-03T13:00:13.425 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:13.421+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:13.421855+0000) 2021-08-03T13:00:13.806 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:13.800+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:13.801600+0000) 2021-08-03T13:00:14.209 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:14.205+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:14.205988+0000) 2021-08-03T13:00:14.428 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:14.424+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:14.424884+0000) 2021-08-03T13:00:14.806 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:14.801+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:14.802389+0000) 2021-08-03T13:00:15.361 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:15.356+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:15.357315+0000) 2021-08-03T13:00:15.431 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:15.426+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:15.427467+0000) 2021-08-03T13:00:15.718 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:15.714+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:15.714995+0000) 2021-08-03T13:00:15.807 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:15.802+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:15.802958+0000) 2021-08-03T13:00:16.055 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:15.964+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3847 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:16.143 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:16.075+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9024 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:16.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:16.428+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:16.429214+0000) 2021-08-03T13:00:16.807 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:16.802+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:16.803566+0000) 2021-08-03T13:00:17.167 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:17.161+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:17.161996+0000) 2021-08-03T13:00:17.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:17.428+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:17.429339+0000) 2021-08-03T13:00:17.684 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:17.678+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:17.679239+0000) 2021-08-03T13:00:17.809 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:17.803+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:17.804342+0000) 2021-08-03T13:00:18.048 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:17.808+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:18.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:18.428+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:18.429588+0000) 2021-08-03T13:00:18.809 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:18.804+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:18.804945+0000) 2021-08-03T13:00:18.852 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:18.848+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:18.849040+0000) 2021-08-03T13:00:19.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:19.428+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:19.429738+0000) 2021-08-03T13:00:19.809 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:19.804+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:19.805498+0000) 2021-08-03T13:00:19.852 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:19.848+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:19.849186+0000) 2021-08-03T13:00:19.946 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:19.941+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:19.942705+0000) 2021-08-03T13:00:20.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:20.212+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:20.213208+0000) 2021-08-03T13:00:20.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:20.429+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:20.429962+0000) 2021-08-03T13:00:20.810 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:20.805+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:20.806090+0000) 2021-08-03T13:00:20.852 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:20.848+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:20.849303+0000) 2021-08-03T13:00:21.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:21.211+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:21.213358+0000) 2021-08-03T13:00:21.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:21.428+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:21.430092+0000) 2021-08-03T13:00:21.740 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:21.733+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:21.735709+0000) 2021-08-03T13:00:21.811 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:21.806+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:21.806848+0000) 2021-08-03T13:00:21.853 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:21.848+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:21.849432+0000) 2021-08-03T13:00:22.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:22.211+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:22.213526+0000) 2021-08-03T13:00:22.252 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:22.246+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9024 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:22.741 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:22.734+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:22.736465+0000) 2021-08-03T13:00:23.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:23.211+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:23.213646+0000) 2021-08-03T13:00:23.510 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:23.504+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:23.505737+0000) 2021-08-03T13:00:23.741 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:23.735+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:23.737058+0000) 2021-08-03T13:00:23.751 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:00:23.744+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:23.746369+0000) 2021-08-03T13:00:23.803 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:23.705+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9404 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:24.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:24.212+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:24.213803+0000) 2021-08-03T13:00:24.510 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:24.505+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:24.506462+0000) 2021-08-03T13:00:24.742 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:24.735+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:24.737603+0000) 2021-08-03T13:00:25.100 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:25.095+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:25.097038+0000) 2021-08-03T13:00:25.111 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:25.101+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3859 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:25.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:25.212+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:25.213977+0000) 2021-08-03T13:00:25.511 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:25.506+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:25.507015+0000) 2021-08-03T13:00:25.743 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:25.736+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:25.738219+0000) 2021-08-03T13:00:26.147 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:00:26.141+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:26.142112+0000) 2021-08-03T13:00:26.218 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:26.212+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:26.214091+0000) 2021-08-03T13:00:26.409 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:26.403+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:26.404776+0000) 2021-08-03T13:00:26.515 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:26.507+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:26.507983+0000) 2021-08-03T13:00:26.743 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:26.737+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:26.738847+0000) 2021-08-03T13:00:27.218 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:27.212+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:27.214250+0000) 2021-08-03T13:00:27.516 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:27.510+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:27.511446+0000) 2021-08-03T13:00:28.516 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:28.511+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:28.512004+0000) 2021-08-03T13:00:29.080 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:29.010+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9024 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:29.804 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:29.797+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:29.799112+0000) 2021-08-03T13:00:29.883 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:00:29.876+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:29.878420+0000) 2021-08-03T13:00:30.272 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:30.265+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:30.266654+0000) 2021-08-03T13:00:30.804 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:30.799+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:30.799831+0000) 2021-08-03T13:00:31.196 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:31.191+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:31.192151+0000) 2021-08-03T13:00:31.805 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:31.799+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:31.800470+0000) 2021-08-03T13:00:31.888 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:31.882+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9439 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:32.559 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:32.554+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:32.555533+0000) 2021-08-03T13:00:32.805 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:32.800+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:32.801089+0000) 2021-08-03T13:00:32.902 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:32.897+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:32.898292+0000) 2021-08-03T13:00:33.076 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:33.071+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:33.072713+0000) 2021-08-03T13:00:33.194 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:33.119+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3867 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:33.236 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:33.232+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:33.233034+0000) 2021-08-03T13:00:33.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:33.558+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:33.559767+0000) 2021-08-03T13:00:33.806 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:33.801+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:33.801885+0000) 2021-08-03T13:00:33.903 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:33.898+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:33.899277+0000) 2021-08-03T13:00:34.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:34.232+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:34.233178+0000) 2021-08-03T13:00:34.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:34.563+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:34.564131+0000) 2021-08-03T13:00:34.807 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:34.801+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:34.802705+0000) 2021-08-03T13:00:34.904 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:34.899+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:34.899843+0000) 2021-08-03T13:00:34.981 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:34.976+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:34.977632+0000) 2021-08-03T13:00:35.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:35.232+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:35.233318+0000) 2021-08-03T13:00:35.507 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:35.501+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:35.502056+0000) 2021-08-03T13:00:35.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:35.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:35.565857+0000) 2021-08-03T13:00:35.840 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:35.799+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9024 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:35.995 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:00:35.989+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:35.990240+0000) 2021-08-03T13:00:36.023 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:36.019+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:36.019991+0000) 2021-08-03T13:00:36.237 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:36.232+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:36.233428+0000) 2021-08-03T13:00:36.260 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:36.253+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:36.254776+0000) 2021-08-03T13:00:36.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:36.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:36.566066+0000) 2021-08-03T13:00:37.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:37.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:37.566194+0000) 2021-08-03T13:00:38.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:38.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:38.566414+0000) 2021-08-03T13:00:39.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:39.565+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:39.566551+0000) 2021-08-03T13:00:39.949 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:00:39.942+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:39.944241+0000) 2021-08-03T13:00:40.303 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:00:40.297+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:40.298550+0000) 2021-08-03T13:00:40.419 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:40.319+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:40.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:40.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:40.566838+0000) 2021-08-03T13:00:40.949 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:00:40.943+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:40.944979+0000) 2021-08-03T13:00:41.177 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:41.173+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:41.174016+0000) 2021-08-03T13:00:41.570 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:41.566+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:41.566985+0000) 2021-08-03T13:00:41.702 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:41.695+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:41.696395+0000) 2021-08-03T13:00:41.767 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:41.691+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3867 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:41.950 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:00:41.943+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:41.945581+0000) 2021-08-03T13:00:42.039 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:00:42.034+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:42.034842+0000) 2021-08-03T13:00:42.366 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:42.361+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:42.362612+0000) 2021-08-03T13:00:44.032 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:43.964+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9024 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:44.219 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:44.214+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:44.215793+0000) 2021-08-03T13:00:45.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:45.089+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:45.089975+0000) 2021-08-03T13:00:46.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:46.089+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:46.090135+0000) 2021-08-03T13:00:47.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:47.089+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:47.090296+0000) 2021-08-03T13:00:47.171 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:47.165+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:47.166387+0000) 2021-08-03T13:00:47.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:47.358+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:47.358840+0000) 2021-08-03T13:00:47.386 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:47.380+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:47.380767+0000) 2021-08-03T13:00:47.790 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:47.784+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:48.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:48.089+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:48.090442+0000) 2021-08-03T13:00:48.136 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:48.131+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:48.132149+0000) 2021-08-03T13:00:48.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:48.358+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:48.358996+0000) 2021-08-03T13:00:48.516 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:48.511+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:48.512248+0000) 2021-08-03T13:00:49.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:49.089+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:49.090557+0000) 2021-08-03T13:00:49.137 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:49.132+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:49.132864+0000) 2021-08-03T13:00:49.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:49.358+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:49.359116+0000) 2021-08-03T13:00:49.457 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:49.277+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3871 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:49.521 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:49.515+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:49.516099+0000) 2021-08-03T13:00:49.632 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:49.626+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9024 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:50.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:50.089+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:50.090694+0000) 2021-08-03T13:00:50.137 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:50.132+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:50.133455+0000) 2021-08-03T13:00:50.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:50.358+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:50.359258+0000) 2021-08-03T13:00:50.521 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:50.516+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:50.517164+0000) 2021-08-03T13:00:50.530 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:50.525+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:50.525885+0000) 2021-08-03T13:00:51.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:51.089+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.090804+0000) 2021-08-03T13:00:51.138 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:51.133+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.134040+0000) 2021-08-03T13:00:51.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:51.164+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.165530+0000) 2021-08-03T13:00:51.360 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:00:51.354+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.354891+0000) 2021-08-03T13:00:51.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:51.358+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.359396+0000) 2021-08-03T13:00:51.522 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:51.516+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.517761+0000) 2021-08-03T13:00:51.531 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:51.525+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.526579+0000) 2021-08-03T13:00:51.974 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:00:51.969+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:51.970244+0000) 2021-08-03T13:00:52.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:52.090+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.090936+0000) 2021-08-03T13:00:52.139 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:52.133+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.134612+0000) 2021-08-03T13:00:52.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:52.164+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.165688+0000) 2021-08-03T13:00:52.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:52.358+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.359532+0000) 2021-08-03T13:00:52.523 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:52.517+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.518318+0000) 2021-08-03T13:00:52.531 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:52.526+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.527143+0000) 2021-08-03T13:00:52.644 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:00:52.639+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.640711+0000) 2021-08-03T13:00:52.696 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:52.691+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.692460+0000) 2021-08-03T13:00:52.975 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:00:52.970+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:52.971002+0000) 2021-08-03T13:00:53.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:53.090+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.091049+0000) 2021-08-03T13:00:53.139 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:53.134+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.135255+0000) 2021-08-03T13:00:53.169 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:53.165+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.165841+0000) 2021-08-03T13:00:53.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:53.358+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.359678+0000) 2021-08-03T13:00:53.532 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:53.527+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.527850+0000) 2021-08-03T13:00:53.533 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:53.520+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.521291+0000) 2021-08-03T13:00:53.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:53.695+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.696008+0000) 2021-08-03T13:00:53.879 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:00:53.779+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:00:53.976 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:00:53.970+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:53.971600+0000) 2021-08-03T13:00:54.095 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:54.090+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:54.091196+0000) 2021-08-03T13:00:54.526 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:54.521+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:54.521890+0000) 2021-08-03T13:00:54.533 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:54.527+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:54.528445+0000) 2021-08-03T13:00:54.702 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:54.697+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:54.698551+0000) 2021-08-03T13:00:55.533 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:55.528+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:55.529458+0000) 2021-08-03T13:00:55.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:55.700+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:55.701548+0000) 2021-08-03T13:00:56.171 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:00:56.165+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:56.166109+0000) 2021-08-03T13:00:56.477 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:56.472+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:56.473545+0000) 2021-08-03T13:00:56.481 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:00:56.473+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:56.473946+0000) 2021-08-03T13:00:56.534 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:56.529+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:56.530378+0000) 2021-08-03T13:00:56.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:56.700+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:56.701789+0000) 2021-08-03T13:00:57.159 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:00:57.152+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:57.153657+0000) 2021-08-03T13:00:57.438 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:00:57.432+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:57.432932+0000) 2021-08-03T13:00:57.535 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:00:57.530+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:57.530974+0000) 2021-08-03T13:00:57.682 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T13:00:57.677+0000 7f57d57e4700 0 --2- 172.21.15.3:0/3813029560 >> [v2:172.21.15.101:3300/0,v1:172.21.15.101:6789/0] conn(0x7f57b0005ce0 0x7f57b00048e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2021-08-03T13:00:57.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:57.701+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:57.701956+0000) 2021-08-03T13:00:58.065 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:58.061+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:58.061882+0000) 2021-08-03T13:00:58.183 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:00:58.177+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:58.178064+0000) 2021-08-03T13:00:58.233 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:00:58.228+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:00:58.276 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:00:57.592+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3879 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:00:58.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:00:58.878+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:58.879286+0000) 2021-08-03T13:00:59.806 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:00:59.801+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:00:59.801766+0000) 2021-08-03T13:01:00.056 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:00.051+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:00.052399+0000) 2021-08-03T13:01:00.623 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:00.618+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:00.619233+0000) 2021-08-03T13:01:00.639 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:00.634+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:00.635050+0000) 2021-08-03T13:01:00.808 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:00.803+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:00.804106+0000) 2021-08-03T13:01:01.848 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:01.842+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:01.843226+0000) 2021-08-03T13:01:02.467 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:02.275+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:02.814 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:02.809+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:02.810487+0000) 2021-08-03T13:01:02.872 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:02.777+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3894 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:02.944 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:02.938+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:02.938818+0000) 2021-08-03T13:01:03.128 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:03.122+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:03.123149+0000) 2021-08-03T13:01:03.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:03.911+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:03.912041+0000) 2021-08-03T13:01:04.128 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:04.123+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:04.123982+0000) 2021-08-03T13:01:04.488 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:04.484+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:04.485097+0000) 2021-08-03T13:01:04.512 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:01:04.506+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:04.506978+0000) 2021-08-03T13:01:04.730 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:04.725+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:04.726801+0000) 2021-08-03T13:01:04.876 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:04.871+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:04.872125+0000) 2021-08-03T13:01:04.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:04.971+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:04.972238+0000) 2021-08-03T13:01:05.077 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:05.072+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:05.073184+0000) 2021-08-03T13:01:05.129 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:05.123+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:05.124546+0000) 2021-08-03T13:01:05.220 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:05.215+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:05.216614+0000) 2021-08-03T13:01:05.249 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:05.121+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:05.489 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:05.484+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:05.485250+0000) 2021-08-03T13:01:05.495 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:05.490+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:05.491246+0000) 2021-08-03T13:01:05.909 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:05.904+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:05.905386+0000) 2021-08-03T13:01:06.077 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:06.072+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:06.073309+0000) 2021-08-03T13:01:06.129 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:06.124+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:06.125086+0000) 2021-08-03T13:01:06.220 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:06.216+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:06.216808+0000) 2021-08-03T13:01:06.489 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:06.484+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:06.485363+0000) 2021-08-03T13:01:06.911 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:06.905+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:06.906468+0000) 2021-08-03T13:01:07.077 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:07.072+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:07.073443+0000) 2021-08-03T13:01:07.130 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:07.125+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:07.125788+0000) 2021-08-03T13:01:07.220 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:07.216+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:07.216970+0000) 2021-08-03T13:01:07.489 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:07.484+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:07.485511+0000) 2021-08-03T13:01:07.911 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:07.906+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:07.906999+0000) 2021-08-03T13:01:07.938 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:07.932+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:07.932970+0000) 2021-08-03T13:01:08.077 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:08.072+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:08.073584+0000) 2021-08-03T13:01:08.133 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:08.126+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:08.126763+0000) 2021-08-03T13:01:08.220 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:08.216+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:08.217130+0000) 2021-08-03T13:01:08.387 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:08.277+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3907 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:08.831 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:08.826+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:08.827483+0000) 2021-08-03T13:01:08.886 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:08.843+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:08.912 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:08.906+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:08.907592+0000) 2021-08-03T13:01:08.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:08.956+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:08.957336+0000) 2021-08-03T13:01:08.972 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:01:08.966+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:08.967140+0000) 2021-08-03T13:01:09.221 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:09.216+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:09.217252+0000) 2021-08-03T13:01:09.335 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:09.329+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:09.330097+0000) 2021-08-03T13:01:09.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:09.351+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:09.353736+0000) 2021-08-03T13:01:09.912 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:09.907+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:09.908609+0000) 2021-08-03T13:01:10.156 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:10.149+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:10.151514+0000) 2021-08-03T13:01:10.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:10.352+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:10.353866+0000) 2021-08-03T13:01:10.756 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:10.752+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:10.753117+0000) 2021-08-03T13:01:10.914 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:10.908+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:10.909683+0000) 2021-08-03T13:01:11.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:11.018+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:11.020280+0000) 2021-08-03T13:01:11.145 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:11.085+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:11.357 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:11.352+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:11.353987+0000) 2021-08-03T13:01:11.861 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:11.856+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:11.856974+0000) 2021-08-03T13:01:11.915 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:11.909+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:11.910520+0000) 2021-08-03T13:01:12.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:12.693+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:12.695373+0000) 2021-08-03T13:01:13.605 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:13.343+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3914 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:14.745 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:14.740+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:14.741977+0000) 2021-08-03T13:01:15.311 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:15.168+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:15.334 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:15.328+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:15.329397+0000) 2021-08-03T13:01:16.189 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:16.183+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:16.183907+0000) 2021-08-03T13:01:16.859 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:16.853+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:16.854285+0000) 2021-08-03T13:01:17.154 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:17.146+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:17.148156+0000) 2021-08-03T13:01:17.170 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:17.164+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:17.166596+0000) 2021-08-03T13:01:17.384 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:17.143+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:17.390 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:01:17.383+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:17.385575+0000) 2021-08-03T13:01:17.391 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:17.385+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:17.387592+0000) 2021-08-03T13:01:17.394 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:17.389+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:17.390784+0000) 2021-08-03T13:01:18.228 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:18.222+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:18.223549+0000) 2021-08-03T13:01:18.614 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:18.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:18.610884+0000) 2021-08-03T13:01:19.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:19.558+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:19.559597+0000) 2021-08-03T13:01:19.614 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:19.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:19.611002+0000) 2021-08-03T13:01:19.959 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:19.954+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:19.955161+0000) 2021-08-03T13:01:20.346 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:20.341+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:20.342692+0000) 2021-08-03T13:01:20.426 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:20.420+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3929 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:20.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:20.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:20.611122+0000) 2021-08-03T13:01:20.962 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:20.957+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:20.958413+0000) 2021-08-03T13:01:21.346 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:21.342+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:21.342854+0000) 2021-08-03T13:01:21.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:21.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:21.611260+0000) 2021-08-03T13:01:21.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:21.960+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:21.960993+0000) 2021-08-03T13:01:22.346 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:22.342+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:22.343007+0000) 2021-08-03T13:01:22.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:22.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:22.611376+0000) 2021-08-03T13:01:22.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:22.706+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:22.706811+0000) 2021-08-03T13:01:22.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:22.963+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:22.964049+0000) 2021-08-03T13:01:23.347 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:23.342+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:23.343132+0000) 2021-08-03T13:01:23.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:23.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:23.611519+0000) 2021-08-03T13:01:23.968 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:23.963+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:23.964160+0000) 2021-08-03T13:01:24.019 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:24.013+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:24.014571+0000) 2021-08-03T13:01:24.090 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:24.084+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:24.085647+0000) 2021-08-03T13:01:24.161 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:24.119+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:24.347 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:24.342+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:24.343276+0000) 2021-08-03T13:01:24.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:24.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:24.611652+0000) 2021-08-03T13:01:24.803 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:24.341+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9448 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:24.968 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:24.963+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:24.964414+0000) 2021-08-03T13:01:25.356 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:25.349+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:25.350376+0000) 2021-08-03T13:01:25.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:25.610+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:25.611793+0000) 2021-08-03T13:01:25.802 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:01:25.796+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:25.797164+0000) 2021-08-03T13:01:25.820 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:25.815+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:25.815902+0000) 2021-08-03T13:01:26.480 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:26.476+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:26.476932+0000) 2021-08-03T13:01:26.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:26.611+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:26.611930+0000) 2021-08-03T13:01:26.821 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:26.816+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:26.816998+0000) 2021-08-03T13:01:26.856 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:26.852+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:26.852889+0000) 2021-08-03T13:01:26.955 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:26.948+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:26.949777+0000) 2021-08-03T13:01:27.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:27.541+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:27.541859+0000) 2021-08-03T13:01:27.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:27.611+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:27.612056+0000) 2021-08-03T13:01:27.822 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:27.817+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:27.817933+0000) 2021-08-03T13:01:27.872 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:27.865+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:27.866146+0000) 2021-08-03T13:01:28.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:28.392+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:28.393228+0000) 2021-08-03T13:01:28.545 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:28.541+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:28.542033+0000) 2021-08-03T13:01:28.615 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:28.611+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:28.612189+0000) 2021-08-03T13:01:28.825 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:28.819+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:28.820341+0000) 2021-08-03T13:01:29.077 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:29.073+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:29.074081+0000) 2021-08-03T13:01:29.297 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:29.264+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3943 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:29.546 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:29.541+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:29.542171+0000) 2021-08-03T13:01:29.616 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:29.611+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:29.612359+0000) 2021-08-03T13:01:29.825 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:29.820+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:29.821277+0000) 2021-08-03T13:01:30.078 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:30.073+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:30.074216+0000) 2021-08-03T13:01:30.294 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:30.288+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:30.288852+0000) 2021-08-03T13:01:30.616 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:30.611+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:30.612506+0000) 2021-08-03T13:01:30.827 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:30.821+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:30.822222+0000) 2021-08-03T13:01:31.078 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:31.073+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:31.074374+0000) 2021-08-03T13:01:31.306 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:31.301+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:31.302078+0000) 2021-08-03T13:01:31.602 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:31.596+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9466 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:31.616 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:31.611+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:31.612638+0000) 2021-08-03T13:01:32.113 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:32.107+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:32.108283+0000) 2021-08-03T13:01:32.575 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:32.318+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:32.616 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:32.611+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:32.612790+0000) 2021-08-03T13:01:33.617 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:33.612+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:33.612944+0000) 2021-08-03T13:01:34.617 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:34.612+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:34.613109+0000) 2021-08-03T13:01:34.691 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:34.686+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:34.686847+0000) 2021-08-03T13:01:34.931 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:34.924+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:34.925267+0000) 2021-08-03T13:01:35.115 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:35.111+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:35.112079+0000) 2021-08-03T13:01:35.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:35.467+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:35.468696+0000) 2021-08-03T13:01:35.617 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:35.612+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:35.613258+0000) 2021-08-03T13:01:36.093 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:36.089+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:36.089807+0000) 2021-08-03T13:01:36.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:36.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:36.468837+0000) 2021-08-03T13:01:36.617 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:36.612+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:36.613375+0000) 2021-08-03T13:01:37.023 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:37.018+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3952 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:37.281 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:37.274+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:37.275700+0000) 2021-08-03T13:01:37.469 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:37.453+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9475 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:37.471 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:37.467+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:37.468275+0000) 2021-08-03T13:01:37.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:37.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:37.468946+0000) 2021-08-03T13:01:37.617 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:37.612+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:37.613537+0000) 2021-08-03T13:01:38.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:38.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:38.469091+0000) 2021-08-03T13:01:38.485 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:38.479+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:38.479869+0000) 2021-08-03T13:01:38.617 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:38.612+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:38.613697+0000) 2021-08-03T13:01:38.891 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:38.887+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:38.888098+0000) 2021-08-03T13:01:39.183 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:39.178+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:39.179498+0000) 2021-08-03T13:01:39.220 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:39.214+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:39.215314+0000) 2021-08-03T13:01:39.472 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:39.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:39.469204+0000) 2021-08-03T13:01:39.526 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:39.520+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:39.784 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:39.780+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:39.780912+0000) 2021-08-03T13:01:40.058 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:01:40.052+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:40.053648+0000) 2021-08-03T13:01:40.273 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:40.267+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:40.268786+0000) 2021-08-03T13:01:40.297 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:01:40.291+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:40.292060+0000) 2021-08-03T13:01:40.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:40.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:40.469334+0000) 2021-08-03T13:01:41.434 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:41.428+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:41.429384+0000) 2021-08-03T13:01:41.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:41.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:41.469491+0000) 2021-08-03T13:01:41.629 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:41.623+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:41.623789+0000) 2021-08-03T13:01:41.647 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:41.643+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:41.644307+0000) 2021-08-03T13:01:42.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:42.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:42.469603+0000) 2021-08-03T13:01:42.922 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:42.916+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:42.917534+0000) 2021-08-03T13:01:42.959 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:42.954+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:42.955171+0000) 2021-08-03T13:01:43.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:43.468+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:43.469757+0000) 2021-08-03T13:01:43.922 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:43.917+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:43.918229+0000) 2021-08-03T13:01:43.960 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:43.955+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:43.955872+0000) 2021-08-03T13:01:44.473 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:44.469+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:44.469878+0000) 2021-08-03T13:01:44.923 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:44.917+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:44.918794+0000) 2021-08-03T13:01:44.960 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:44.955+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:44.956680+0000) 2021-08-03T13:01:45.474 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:45.469+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:45.470022+0000) 2021-08-03T13:01:45.533 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:45.527+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:45.528755+0000) 2021-08-03T13:01:45.733 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:45.729+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:45.730025+0000) 2021-08-03T13:01:45.924 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:45.918+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:45.919355+0000) 2021-08-03T13:01:45.962 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:45.956+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:45.957656+0000) 2021-08-03T13:01:46.367 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:46.363+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:46.364087+0000) 2021-08-03T13:01:46.534 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:46.529+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:46.529846+0000) 2021-08-03T13:01:46.552 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:46.529+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:46.734 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:46.729+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:46.730122+0000) 2021-08-03T13:01:46.924 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:46.919+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:46.919929+0000) 2021-08-03T13:01:46.963 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:46.957+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:46.958481+0000) 2021-08-03T13:01:47.318 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:47.291+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9503 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:47.925 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:47.918+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:47.920705+0000) 2021-08-03T13:01:47.964 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:47.957+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:47.959308+0000) 2021-08-03T13:01:48.315 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:48.307+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:48.309738+0000) 2021-08-03T13:01:48.926 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:48.919+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:48.921478+0000) 2021-08-03T13:01:48.964 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:48.958+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:48.960128+0000) 2021-08-03T13:01:49.315 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:49.309+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:49.310752+0000) 2021-08-03T13:01:49.416 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:49.254+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3960 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:49.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:49.558+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:49.559309+0000) 2021-08-03T13:01:49.572 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:01:49.566+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:49.566931+0000) 2021-08-03T13:01:49.927 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:49.920+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:49.922024+0000) 2021-08-03T13:01:49.965 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:49.959+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:49.960917+0000) 2021-08-03T13:01:50.099 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:50.094+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:50.095346+0000) 2021-08-03T13:01:50.316 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:50.309+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:50.311567+0000) 2021-08-03T13:01:50.329 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:50.324+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:50.326163+0000) 2021-08-03T13:01:50.332 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:50.327+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:50.328797+0000) 2021-08-03T13:01:50.927 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:50.920+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:50.922588+0000) 2021-08-03T13:01:50.966 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:50.959+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:50.961507+0000) 2021-08-03T13:01:51.317 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:51.310+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:51.312679+0000) 2021-08-03T13:01:51.324 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:51.318+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:51.318848+0000) 2021-08-03T13:01:51.799 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:51.794+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:51.795345+0000) 2021-08-03T13:01:52.078 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:52.072+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:52.074753+0000) 2021-08-03T13:01:52.292 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:52.270+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:52.324 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:52.319+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:52.319811+0000) 2021-08-03T13:01:53.078 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:53.073+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:53.074907+0000) 2021-08-03T13:01:53.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:53.219+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:53.220331+0000) 2021-08-03T13:01:53.309 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:01:53.303+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:53.303953+0000) 2021-08-03T13:01:53.325 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:53.320+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:53.320778+0000) 2021-08-03T13:01:53.734 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:53.727+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:53.729230+0000) 2021-08-03T13:01:54.078 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:54.073+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:54.075043+0000) 2021-08-03T13:01:54.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:54.219+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:54.220449+0000) 2021-08-03T13:01:54.326 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:54.321+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:54.321736+0000) 2021-08-03T13:01:54.383 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:01:54.158+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9514 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:01:54.985 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:01:54.979+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:54.980588+0000) 2021-08-03T13:01:55.079 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:55.073+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:55.075175+0000) 2021-08-03T13:01:55.224 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:55.219+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:55.220588+0000) 2021-08-03T13:01:55.328 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:55.321+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:55.322401+0000) 2021-08-03T13:01:55.418 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:01:55.151+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3960 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:01:55.962 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:01:55.956+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:55.956832+0000) 2021-08-03T13:01:56.033 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:01:56.026+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:56.027170+0000) 2021-08-03T13:01:56.327 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:56.322+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:56.323081+0000) 2021-08-03T13:01:57.135 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:57.130+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:57.131771+0000) 2021-08-03T13:01:57.187 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:01:57.181+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:57.181826+0000) 2021-08-03T13:01:57.328 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:57.322+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:57.323646+0000) 2021-08-03T13:01:57.493 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:57.488+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:57.489433+0000) 2021-08-03T13:01:57.796 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:57.790+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:57.792674+0000) 2021-08-03T13:01:58.328 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:58.322+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:58.324264+0000) 2021-08-03T13:01:58.493 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:58.487+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:58.489586+0000) 2021-08-03T13:01:59.166 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:59.161+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:59.162917+0000) 2021-08-03T13:01:59.329 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:01:59.323+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:59.324879+0000) 2021-08-03T13:01:59.464 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:01:59.458+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:01:59.493 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:01:59.487+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:59.489713+0000) 2021-08-03T13:01:59.795 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:01:59.789+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:59.790516+0000) 2021-08-03T13:01:59.804 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:01:59.799+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:01:59.800460+0000) 2021-08-03T13:02:00.330 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:00.323+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:00.325465+0000) 2021-08-03T13:02:00.493 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:00.488+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:00.489873+0000) 2021-08-03T13:02:01.207 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:01.146+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3981 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:01.331 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:01.324+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:01.326058+0000) 2021-08-03T13:02:01.493 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:01.488+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:01.489994+0000) 2021-08-03T13:02:01.496 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:01.491+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:01.492913+0000) 2021-08-03T13:02:02.331 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:02.325+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:02.326800+0000) 2021-08-03T13:02:02.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:02.405+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:02.407233+0000) 2021-08-03T13:02:02.824 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:02.772+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9530 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:03.198 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:02:03.191+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:03.193212+0000) 2021-08-03T13:02:03.332 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:03.325+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:03.327404+0000) 2021-08-03T13:02:03.736 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:03.730+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:03.730924+0000) 2021-08-03T13:02:04.093 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:02:04.086+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:04.087649+0000) 2021-08-03T13:02:04.332 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:04.326+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:04.328058+0000) 2021-08-03T13:02:05.333 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:05.326+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:05.328649+0000) 2021-08-03T13:02:05.596 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:05.589+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:05.591524+0000) 2021-08-03T13:02:05.753 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:05.747+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:05.748145+0000) 2021-08-03T13:02:05.857 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:05.850+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:05.882 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:02:05.876+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:05.877050+0000) 2021-08-03T13:02:06.280 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:06.274+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:06.275914+0000) 2021-08-03T13:02:06.280 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:06.180+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3987 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:06.333 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:06.327+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:06.329249+0000) 2021-08-03T13:02:06.349 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:06.344+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:06.346045+0000) 2021-08-03T13:02:06.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:06.449+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:06.451405+0000) 2021-08-03T13:02:07.335 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:07.329+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:07.330173+0000) 2021-08-03T13:02:08.335 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:08.330+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:08.330771+0000) 2021-08-03T13:02:08.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:08.763+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:08.764381+0000) 2021-08-03T13:02:09.143 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:09.136+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:09.137149+0000) 2021-08-03T13:02:09.336 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:09.330+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:09.331352+0000) 2021-08-03T13:02:09.550 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:02:09.544+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:09.545030+0000) 2021-08-03T13:02:10.216 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:02:10.209+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:10.210610+0000) 2021-08-03T13:02:10.336 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:10.331+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:10.331874+0000) 2021-08-03T13:02:10.434 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:10.428+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9551 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:10.547 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:10.542+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:10.543609+0000) 2021-08-03T13:02:10.994 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:10.989+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:10.990356+0000) 2021-08-03T13:02:11.341 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:11.331+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:11.332413+0000) 2021-08-03T13:02:11.661 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:11.655+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:11.655928+0000) 2021-08-03T13:02:12.619 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:12.614+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:12.615340+0000) 2021-08-03T13:02:12.784 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:12.778+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:12.779390+0000) 2021-08-03T13:02:13.019 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:13.013+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:13.014020+0000) 2021-08-03T13:02:13.361 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:13.091+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:14.205 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:14.199+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:14.200052+0000) 2021-08-03T13:02:14.284 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:14.279+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:14.280531+0000) 2021-08-03T13:02:14.695 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:14.613+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3988 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:14.700 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:14.693+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:14.694522+0000) 2021-08-03T13:02:14.922 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:02:14.916+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:14.916924+0000) 2021-08-03T13:02:16.049 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:16.044+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:16.045052+0000) 2021-08-03T13:02:16.079 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:16.074+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:16.075589+0000) 2021-08-03T13:02:17.079 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:17.074+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:17.075727+0000) 2021-08-03T13:02:17.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:17.470+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:17.471447+0000) 2021-08-03T13:02:17.539 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:17.533+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:17.534736+0000) 2021-08-03T13:02:18.079 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:18.074+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:18.075863+0000) 2021-08-03T13:02:18.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:18.470+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:18.471592+0000) 2021-08-03T13:02:18.539 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:18.534+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:18.535449+0000) 2021-08-03T13:02:18.568 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:18.469+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:18.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:18.565+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:18.565980+0000) 2021-08-03T13:02:18.601 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:18.596+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:18.597744+0000) 2021-08-03T13:02:19.079 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:19.075+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:19.075990+0000) 2021-08-03T13:02:19.263 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:19.256+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:19.257635+0000) 2021-08-03T13:02:19.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:19.470+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:19.471745+0000) 2021-08-03T13:02:19.540 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:19.535+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:19.535989+0000) 2021-08-03T13:02:19.604 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:19.599+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:19.600383+0000) 2021-08-03T13:02:20.079 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:20.075+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:20.076111+0000) 2021-08-03T13:02:20.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:20.471+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:20.471856+0000) 2021-08-03T13:02:20.480 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:02:20.473+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:20.474008+0000) 2021-08-03T13:02:20.541 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:20.535+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:20.536575+0000) 2021-08-03T13:02:20.607 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:20.602+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:20.603077+0000) 2021-08-03T13:02:20.822 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:20.764+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:21.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:21.604+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:21.604951+0000) 2021-08-03T13:02:21.845 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:21.625+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 3998 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:21.932 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:02:21.927+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:21.928221+0000) 2021-08-03T13:02:22.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:22.604+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:22.605167+0000) 2021-08-03T13:02:22.933 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:02:22.928+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:22.929152+0000) 2021-08-03T13:02:23.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:23.563+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:23.564105+0000) 2021-08-03T13:02:23.574 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:23.568+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:23.569027+0000) 2021-08-03T13:02:23.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:23.604+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:23.605310+0000) 2021-08-03T13:02:24.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:24.604+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:24.605537+0000) 2021-08-03T13:02:24.685 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:24.281+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:25.017 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:25.011+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:25.011843+0000) 2021-08-03T13:02:25.598 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:25.594+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:25.594923+0000) 2021-08-03T13:02:25.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:25.604+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:25.605674+0000) 2021-08-03T13:02:25.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:25.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:25.699572+0000) 2021-08-03T13:02:26.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:26.605+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:26.605907+0000) 2021-08-03T13:02:26.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:26.698+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:26.699711+0000) 2021-08-03T13:02:27.573 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:27.567+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:27.567767+0000) 2021-08-03T13:02:27.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:27.605+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:27.606030+0000) 2021-08-03T13:02:27.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:27.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:27.699844+0000) 2021-08-03T13:02:27.758 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:27.752+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:27.753259+0000) 2021-08-03T13:02:28.510 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:02:28.504+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:28.505026+0000) 2021-08-03T13:02:28.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:28.605+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:28.606285+0000) 2021-08-03T13:02:28.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:28.651+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:28.652201+0000) 2021-08-03T13:02:28.686 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:02:28.680+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:28.681091+0000) 2021-08-03T13:02:28.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:28.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:28.699938+0000) 2021-08-03T13:02:29.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:29.605+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:29.606465+0000) 2021-08-03T13:02:29.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:29.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:29.700071+0000) 2021-08-03T13:02:29.726 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:29.428+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:30.404 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:30.328+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4022 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:30.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:30.605+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:30.606703+0000) 2021-08-03T13:02:30.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:30.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:30.700206+0000) 2021-08-03T13:02:30.861 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:30.853+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:30.854370+0000) 2021-08-03T13:02:30.962 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:30.955+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:31.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:31.606+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:31.606858+0000) 2021-08-03T13:02:31.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:31.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:31.700334+0000) 2021-08-03T13:02:31.837 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:31.832+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:31.833192+0000) 2021-08-03T13:02:32.611 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:32.606+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:32.607072+0000) 2021-08-03T13:02:32.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:32.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:32.700476+0000) 2021-08-03T13:02:32.838 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:32.833+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:32.833906+0000) 2021-08-03T13:02:33.611 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:33.606+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:33.607183+0000) 2021-08-03T13:02:33.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:33.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:33.700592+0000) 2021-08-03T13:02:33.839 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:33.833+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:33.834497+0000) 2021-08-03T13:02:34.611 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:34.606+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:34.607463+0000) 2021-08-03T13:02:34.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:34.699+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:34.700724+0000) 2021-08-03T13:02:34.839 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:34.834+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:34.835109+0000) 2021-08-03T13:02:34.869 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:34.864+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:34.865397+0000) 2021-08-03T13:02:35.453 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:35.432+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9026 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:35.611 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:35.606+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:35.607615+0000) 2021-08-03T13:02:35.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:35.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:35.700850+0000) 2021-08-03T13:02:35.840 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:35.834+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:35.835664+0000) 2021-08-03T13:02:36.487 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:36.482+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:36.483744+0000) 2021-08-03T13:02:36.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:36.606+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:36.607795+0000) 2021-08-03T13:02:36.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:36.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:36.701003+0000) 2021-08-03T13:02:36.841 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:36.835+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:36.836432+0000) 2021-08-03T13:02:37.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:37.607+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:37.607911+0000) 2021-08-03T13:02:37.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:37.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:37.701171+0000) 2021-08-03T13:02:37.841 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:37.836+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:37.837022+0000) 2021-08-03T13:02:38.032 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:38.026+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:38.027656+0000) 2021-08-03T13:02:38.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:38.607+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:38.608196+0000) 2021-08-03T13:02:38.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:38.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:38.701297+0000) 2021-08-03T13:02:38.842 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:38.836+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:38.837610+0000) 2021-08-03T13:02:38.969 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:38.765+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:39.145 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:39.139+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:39.140683+0000) 2021-08-03T13:02:39.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:39.607+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:39.608359+0000) 2021-08-03T13:02:39.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:39.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:39.701455+0000) 2021-08-03T13:02:39.843 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:39.837+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:39.838163+0000) 2021-08-03T13:02:40.146 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:40.140+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:40.141349+0000) 2021-08-03T13:02:40.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:40.607+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:40.608571+0000) 2021-08-03T13:02:40.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:40.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:40.701560+0000) 2021-08-03T13:02:40.843 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:40.838+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:40.838730+0000) 2021-08-03T13:02:40.987 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:39.928+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4038 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:41.080 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:41.075+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:41.076468+0000) 2021-08-03T13:02:41.146 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:41.141+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:41.141930+0000) 2021-08-03T13:02:41.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:41.607+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:41.608684+0000) 2021-08-03T13:02:41.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:41.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:41.701660+0000) 2021-08-03T13:02:41.844 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:41.838+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:41.839483+0000) 2021-08-03T13:02:42.080 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:42.075+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:42.076615+0000) 2021-08-03T13:02:42.147 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:42.142+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:42.142725+0000) 2021-08-03T13:02:42.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:42.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:42.608872+0000) 2021-08-03T13:02:42.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:42.700+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:42.701778+0000) 2021-08-03T13:02:42.845 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:42.840+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:42.840744+0000) 2021-08-03T13:02:43.080 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:43.075+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:43.076755+0000) 2021-08-03T13:02:43.148 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:43.142+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:43.143367+0000) 2021-08-03T13:02:43.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:43.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:43.608987+0000) 2021-08-03T13:02:43.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:43.701+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:43.701892+0000) 2021-08-03T13:02:43.845 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:43.840+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:43.841328+0000) 2021-08-03T13:02:43.851 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:43.481+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9036 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:44.080 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:44.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:44.076899+0000) 2021-08-03T13:02:44.148 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:44.143+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:44.143966+0000) 2021-08-03T13:02:44.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:44.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:44.609264+0000) 2021-08-03T13:02:44.705 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:44.701+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:44.702033+0000) 2021-08-03T13:02:44.846 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:44.841+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:44.841918+0000) 2021-08-03T13:02:45.080 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:45.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:45.077030+0000) 2021-08-03T13:02:45.113 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:02:45.105+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:45.106567+0000) 2021-08-03T13:02:45.149 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:02:45.143+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:45.144572+0000) 2021-08-03T13:02:45.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:45.608+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:45.609409+0000) 2021-08-03T13:02:45.699 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:45.572+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:45.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:45.701+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:45.702165+0000) 2021-08-03T13:02:45.847 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:45.841+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:45.842503+0000) 2021-08-03T13:02:46.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:46.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:46.077158+0000) 2021-08-03T13:02:46.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:46.582+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:46.584529+0000) 2021-08-03T13:02:46.788 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:46.783+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:46.784974+0000) 2021-08-03T13:02:46.847 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:46.841+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:46.843087+0000) 2021-08-03T13:02:47.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:47.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:47.077313+0000) 2021-08-03T13:02:47.459 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:47.379+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4043 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:47.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:47.783+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:47.785105+0000) 2021-08-03T13:02:47.848 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:47.841+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:47.843667+0000) 2021-08-03T13:02:48.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:48.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:48.077433+0000) 2021-08-03T13:02:48.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:48.783+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:48.785244+0000) 2021-08-03T13:02:48.849 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:48.842+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:48.844491+0000) 2021-08-03T13:02:49.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:49.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:49.077578+0000) 2021-08-03T13:02:49.236 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:02:49.229+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:49.231257+0000) 2021-08-03T13:02:49.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:49.783+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:49.785390+0000) 2021-08-03T13:02:49.849 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:49.843+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:49.845088+0000) 2021-08-03T13:02:50.077 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:50.070+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9046 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:50.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:50.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:50.077715+0000) 2021-08-03T13:02:50.396 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:50.390+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:50.391763+0000) 2021-08-03T13:02:50.699 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:02:50.691+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:50.692224+0000) 2021-08-03T13:02:50.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:50.783+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:50.785515+0000) 2021-08-03T13:02:50.850 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:50.844+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:50.845877+0000) 2021-08-03T13:02:51.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:51.076+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:51.077871+0000) 2021-08-03T13:02:51.546 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:51.540+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:51.541234+0000) 2021-08-03T13:02:51.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:51.783+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:51.785657+0000) 2021-08-03T13:02:51.851 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:51.844+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:51.846447+0000) 2021-08-03T13:02:51.974 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:51.968+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:51.969308+0000) 2021-08-03T13:02:52.081 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:02:52.077+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:52.078027+0000) 2021-08-03T13:02:52.546 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:52.541+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:52.541967+0000) 2021-08-03T13:02:52.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:52.783+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:52.785777+0000) 2021-08-03T13:02:52.852 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:52.846+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:52.847880+0000) 2021-08-03T13:02:52.974 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:52.969+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:52.969991+0000) 2021-08-03T13:02:53.082 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:02:52.642+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9559 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:02:53.233 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:53.227+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:53.229569+0000) 2021-08-03T13:02:53.363 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:53.358+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:53.359910+0000) 2021-08-03T13:02:53.547 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:53.542+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:53.542962+0000) 2021-08-03T13:02:53.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:53.784+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:53.785895+0000) 2021-08-03T13:02:53.853 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:53.846+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:53.848532+0000) 2021-08-03T13:02:53.939 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:02:53.933+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:53.934357+0000) 2021-08-03T13:02:53.974 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:53.969+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:53.970564+0000) 2021-08-03T13:02:54.366 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:54.360+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:54.362282+0000) 2021-08-03T13:02:54.548 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:54.543+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:54.543827+0000) 2021-08-03T13:02:54.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:54.784+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:54.786037+0000) 2021-08-03T13:02:54.853 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:54.847+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:54.849117+0000) 2021-08-03T13:02:54.975 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:54.970+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:54.971148+0000) 2021-08-03T13:02:55.369 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:55.364+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:55.365307+0000) 2021-08-03T13:02:55.549 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:55.543+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:55.544698+0000) 2021-08-03T13:02:55.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:55.785+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:55.786154+0000) 2021-08-03T13:02:55.854 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:55.848+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:55.849714+0000) 2021-08-03T13:02:55.976 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:55.970+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:55.971724+0000) 2021-08-03T13:02:55.997 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:02:55.990+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:55.991630+0000) 2021-08-03T13:02:56.371 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:56.366+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:56.367217+0000) 2021-08-03T13:02:56.549 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:56.544+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:56.545263+0000) 2021-08-03T13:02:56.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:56.785+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:56.786284+0000) 2021-08-03T13:02:56.855 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:56.849+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:56.850532+0000) 2021-08-03T13:02:56.976 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:56.971+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:56.972426+0000) 2021-08-03T13:02:57.373 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:57.366+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:57.367523+0000) 2021-08-03T13:02:57.550 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:57.545+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:57.545863+0000) 2021-08-03T13:02:57.761 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:02:57.599+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4051 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:02:57.766 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:57.761+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:57.762705+0000) 2021-08-03T13:02:57.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:57.785+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:57.786428+0000) 2021-08-03T13:02:57.856 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:57.850+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:57.851408+0000) 2021-08-03T13:02:57.977 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:57.972+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:57.972996+0000) 2021-08-03T13:02:58.371 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:58.366+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:58.367668+0000) 2021-08-03T13:02:58.551 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:58.545+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:58.546814+0000) 2021-08-03T13:02:58.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:58.785+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:58.786582+0000) 2021-08-03T13:02:58.856 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:58.851+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:58.852025+0000) 2021-08-03T13:02:58.978 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:58.971+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:58.973571+0000) 2021-08-03T13:02:59.015 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:02:58.280+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:02:59.371 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:59.367+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:59.367923+0000) 2021-08-03T13:02:59.552 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:02:59.546+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:59.547857+0000) 2021-08-03T13:02:59.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:02:59.785+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:59.786698+0000) 2021-08-03T13:02:59.857 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:02:59.852+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:59.852770+0000) 2021-08-03T13:02:59.978 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:02:59.972+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:02:59.974158+0000) 2021-08-03T13:03:00.372 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:00.367+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:00.368072+0000) 2021-08-03T13:03:00.429 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:00.420+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9563 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:00.553 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:00.546+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:00.548459+0000) 2021-08-03T13:03:00.858 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:00.852+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:00.853345+0000) 2021-08-03T13:03:00.979 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:00.972+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:00.974726+0000) 2021-08-03T13:03:01.556 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:01.547+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:01.549310+0000) 2021-08-03T13:03:01.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:01.709+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:01.710051+0000) 2021-08-03T13:03:01.862 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:01.853+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:01.853965+0000) 2021-08-03T13:03:01.980 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:01.973+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:01.975321+0000) 2021-08-03T13:03:02.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:02.322+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:02.323010+0000) 2021-08-03T13:03:02.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:02.709+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:02.710202+0000) 2021-08-03T13:03:02.981 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:02.974+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:02.976326+0000) 2021-08-03T13:03:03.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:03.709+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:03.710351+0000) 2021-08-03T13:03:03.981 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:03.975+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:03.977140+0000) 2021-08-03T13:03:04.490 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:04.421+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:04.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:04.709+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:04.710525+0000) 2021-08-03T13:03:04.982 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:04.975+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:04.977728+0000) 2021-08-03T13:03:05.642 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:05.532+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4059 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:05.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:05.709+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:05.710653+0000) 2021-08-03T13:03:05.983 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:05.976+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:05.978396+0000) 2021-08-03T13:03:06.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:06.710+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:06.710807+0000) 2021-08-03T13:03:06.983 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:06.978+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:06.979196+0000) 2021-08-03T13:03:06.989 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:03:06.983+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:06.984445+0000) 2021-08-03T13:03:07.006 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:06.999+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:07.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:07.670+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:07.670840+0000) 2021-08-03T13:03:07.714 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:07.710+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:07.710941+0000) 2021-08-03T13:03:07.984 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:07.978+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:07.979785+0000) 2021-08-03T13:03:08.035 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:08.028+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:08.029089+0000) 2021-08-03T13:03:08.122 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:08.117+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:08.118555+0000) 2021-08-03T13:03:08.613 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:08.608+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:08.609720+0000) 2021-08-03T13:03:08.698 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:03:08.692+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:08.693545+0000) 2021-08-03T13:03:08.715 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:08.710+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:08.711092+0000) 2021-08-03T13:03:08.984 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:08.979+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:08.980370+0000) 2021-08-03T13:03:09.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:09.120+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:09.121136+0000) 2021-08-03T13:03:09.985 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:09.980+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:09.980969+0000) 2021-08-03T13:03:10.052 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:10.046+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:10.047427+0000) 2021-08-03T13:03:10.127 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:10.122+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:10.123728+0000) 2021-08-03T13:03:10.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:10.911+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:10.912106+0000) 2021-08-03T13:03:10.986 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:10.980+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:10.981578+0000) 2021-08-03T13:03:11.019 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:11.014+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:11.015212+0000) 2021-08-03T13:03:11.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:11.124+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:11.125690+0000) 2021-08-03T13:03:11.229 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:11.185+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4066 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:11.693 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:11.687+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:11.687761+0000) 2021-08-03T13:03:11.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:11.911+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:11.912283+0000) 2021-08-03T13:03:11.987 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:11.981+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:11.982396+0000) 2021-08-03T13:03:12.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:12.125+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:12.125858+0000) 2021-08-03T13:03:12.356 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:03:12.350+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:12.351284+0000) 2021-08-03T13:03:12.596 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:12.528+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:12.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:12.911+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:12.912442+0000) 2021-08-03T13:03:12.987 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:12.982+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:12.983124+0000) 2021-08-03T13:03:13.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:13.125+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:13.126050+0000) 2021-08-03T13:03:13.140 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:13.135+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:13.136606+0000) 2021-08-03T13:03:13.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:13.911+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:13.912577+0000) 2021-08-03T13:03:14.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:14.125+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:14.126177+0000) 2021-08-03T13:03:14.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:14.911+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:14.912710+0000) 2021-08-03T13:03:15.114 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:03:15.109+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:15.109999+0000) 2021-08-03T13:03:15.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:15.125+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:15.126402+0000) 2021-08-03T13:03:15.244 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:15.133+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:16.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:16.322+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:16.323615+0000) 2021-08-03T13:03:17.398 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:17.391+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:17.392193+0000) 2021-08-03T13:03:17.457 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:17.171+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4071 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:17.801 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:17.796+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:17.797748+0000) 2021-08-03T13:03:18.869 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:18.862+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:18.863696+0000) 2021-08-03T13:03:19.723 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:19.699+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:19.974 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:03:19.968+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:19.969235+0000) 2021-08-03T13:03:20.641 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:20.636+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:20.637471+0000) 2021-08-03T13:03:20.943 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:20.937+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:20.938069+0000) 2021-08-03T13:03:21.484 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:21.479+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:21.480533+0000) 2021-08-03T13:03:21.558 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:21.552+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:21.553577+0000) 2021-08-03T13:03:21.597 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:03:21.590+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:21.591224+0000) 2021-08-03T13:03:21.770 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:03:21.763+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:21.764393+0000) 2021-08-03T13:03:22.456 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:22.451+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:22.452291+0000) 2021-08-03T13:03:22.558 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:22.553+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:22.554185+0000) 2021-08-03T13:03:22.797 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:22.790+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:22.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:22.876+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:22.876860+0000) 2021-08-03T13:03:23.559 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:23.554+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:23.554794+0000) 2021-08-03T13:03:23.625 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:23.618+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:23.619322+0000) 2021-08-03T13:03:23.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:23.879+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:23.880358+0000) 2021-08-03T13:03:23.943 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:23.938+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:23.938883+0000) 2021-08-03T13:03:24.088 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:24.082+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:24.083422+0000) 2021-08-03T13:03:24.560 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:24.554+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:24.555596+0000) 2021-08-03T13:03:24.887 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:24.883+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:24.883840+0000) 2021-08-03T13:03:24.944 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:24.938+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:24.939635+0000) 2021-08-03T13:03:24.944 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:24.013+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4076 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:24.962 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:24.957+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:24.958664+0000) 2021-08-03T13:03:25.088 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:25.083+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:25.084122+0000) 2021-08-03T13:03:25.561 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:25.555+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:25.556702+0000) 2021-08-03T13:03:25.944 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:25.939+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:25.940226+0000) 2021-08-03T13:03:26.001 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:25.994+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:25.994849+0000) 2021-08-03T13:03:26.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:26.037+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:26.038097+0000) 2021-08-03T13:03:26.089 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:26.084+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:26.084723+0000) 2021-08-03T13:03:26.416 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:26.411+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:26.412601+0000) 2021-08-03T13:03:26.448 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:26.443+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:26.444517+0000) 2021-08-03T13:03:26.562 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:26.556+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:26.557346+0000) 2021-08-03T13:03:26.946 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:26.940+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:26.941470+0000) 2021-08-03T13:03:26.988 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:26.898+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:27.042 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:27.037+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:27.038226+0000) 2021-08-03T13:03:27.207 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:27.202+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:27.203157+0000) 2021-08-03T13:03:27.326 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:27.319+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:27.320682+0000) 2021-08-03T13:03:27.416 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:27.411+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:27.412763+0000) 2021-08-03T13:03:27.693 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:27.687+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:27.687965+0000) 2021-08-03T13:03:27.984 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:03:27.978+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:27.979109+0000) 2021-08-03T13:03:28.504 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:28.497+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:28.498526+0000) 2021-08-03T13:03:29.526 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:03:29.520+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:29.521676+0000) 2021-08-03T13:03:29.691 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:29.374+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4084 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:29.721 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:29.644+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:30.194 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:30.189+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:30.190768+0000) 2021-08-03T13:03:31.853 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:03:31.847+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:31.848695+0000) 2021-08-03T13:03:32.342 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:32.336+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:32.337370+0000) 2021-08-03T13:03:32.496 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:32.491+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:32.492764+0000) 2021-08-03T13:03:32.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:32.636+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:32.636832+0000) 2021-08-03T13:03:32.797 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:32.792+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:32.793377+0000) 2021-08-03T13:03:33.433 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:33.428+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:33.429450+0000) 2021-08-03T13:03:33.496 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:33.492+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:33.492917+0000) 2021-08-03T13:03:33.643 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:33.638+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:33.639398+0000) 2021-08-03T13:03:33.860 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:33.496+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9065 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:33.879 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:33.875+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:33.876266+0000) 2021-08-03T13:03:33.955 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:33.948+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:33.949515+0000) 2021-08-03T13:03:34.496 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:34.491+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:34.493039+0000) 2021-08-03T13:03:34.645 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:34.640+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:34.642000+0000) 2021-08-03T13:03:34.948 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:34.912+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:35.528 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:35.505+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4088 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:35.530 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:35.524+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:35.525110+0000) 2021-08-03T13:03:38.167 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:38.161+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:38.163618+0000) 2021-08-03T13:03:38.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:38.666+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:38.668454+0000) 2021-08-03T13:03:39.071 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:39.064+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:39.065804+0000) 2021-08-03T13:03:39.167 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:39.161+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:39.163760+0000) 2021-08-03T13:03:39.276 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:03:39.269+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:39.271040+0000) 2021-08-03T13:03:39.736 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:03:39.730+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:39.731618+0000) 2021-08-03T13:03:39.914 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:03:39.907+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:39.909429+0000) 2021-08-03T13:03:39.958 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:39.603+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9076 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:40.168 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:40.162+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:40.163881+0000) 2021-08-03T13:03:40.435 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:40.429+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:40.431576+0000) 2021-08-03T13:03:40.482 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:40.296+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:40.679 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:40.673+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:40.675649+0000) 2021-08-03T13:03:42.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:42.392+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:42.394241+0000) 2021-08-03T13:03:42.506 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:42.501+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:42.502906+0000) 2021-08-03T13:03:42.575 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:42.568+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:42.570580+0000) 2021-08-03T13:03:42.800 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:42.793+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:42.794794+0000) 2021-08-03T13:03:43.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:43.046+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:43.048468+0000) 2021-08-03T13:03:43.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:43.389+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:43.391058+0000) 2021-08-03T13:03:43.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:43.395+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:43.396856+0000) 2021-08-03T13:03:43.535 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:43.528+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4090 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:44.014 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:44.008+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:44.009344+0000) 2021-08-03T13:03:44.043 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:44.038+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:44.039709+0000) 2021-08-03T13:03:44.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:44.390+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:44.391198+0000) 2021-08-03T13:03:44.404 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:44.399+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:44.400331+0000) 2021-08-03T13:03:44.687 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:03:44.681+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:44.682243+0000) 2021-08-03T13:03:45.000 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:44.994+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:44.995744+0000) 2021-08-03T13:03:45.333 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:45.327+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:45.327905+0000) 2021-08-03T13:03:45.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:45.390+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:45.391351+0000) 2021-08-03T13:03:45.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:45.401+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:45.402216+0000) 2021-08-03T13:03:45.687 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:03:45.682+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:45.682983+0000) 2021-08-03T13:03:46.119 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:03:46.113+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:46.114200+0000) 2021-08-03T13:03:46.156 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:03:46.150+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:46.151402+0000) 2021-08-03T13:03:46.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:46.390+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:46.391497+0000) 2021-08-03T13:03:46.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:46.401+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:46.402339+0000) 2021-08-03T13:03:46.432 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:46.031+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:46.506 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:46.410+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9085 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:46.547 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:46.542+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:46.543595+0000) 2021-08-03T13:03:46.928 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:46.923+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:46.923904+0000) 2021-08-03T13:03:47.124 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:47.119+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:47.120115+0000) 2021-08-03T13:03:47.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:47.390+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:47.391630+0000) 2021-08-03T13:03:47.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:47.401+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:47.402515+0000) 2021-08-03T13:03:47.569 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:47.563+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:47.564247+0000) 2021-08-03T13:03:48.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:48.390+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:48.391729+0000) 2021-08-03T13:03:48.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:48.405+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:48.406743+0000) 2021-08-03T13:03:48.417 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:48.412+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:48.413199+0000) 2021-08-03T13:03:48.570 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:48.564+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:48.565006+0000) 2021-08-03T13:03:49.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:49.391+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:49.391865+0000) 2021-08-03T13:03:49.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:49.408+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:49.409387+0000) 2021-08-03T13:03:49.417 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:49.412+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:49.413349+0000) 2021-08-03T13:03:49.429 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:49.423+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:49.423966+0000) 2021-08-03T13:03:49.608 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:49.602+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:49.603736+0000) 2021-08-03T13:03:50.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:50.391+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:50.392021+0000) 2021-08-03T13:03:50.415 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:50.410+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:50.411382+0000) 2021-08-03T13:03:50.417 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:50.412+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:50.413499+0000) 2021-08-03T13:03:50.608 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:50.603+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:50.604314+0000) 2021-08-03T13:03:51.293 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:51.288+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:51.289292+0000) 2021-08-03T13:03:51.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:51.391+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:51.392160+0000) 2021-08-03T13:03:51.415 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:51.410+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:51.411610+0000) 2021-08-03T13:03:51.417 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:51.412+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:51.413639+0000) 2021-08-03T13:03:51.609 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:51.604+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:51.604912+0000) 2021-08-03T13:03:51.672 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:03:51.667+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:51.667769+0000) 2021-08-03T13:03:51.689 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:51.684+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:51.684928+0000) 2021-08-03T13:03:52.293 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:52.288+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:52.289456+0000) 2021-08-03T13:03:52.356 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:03:52.350+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:52.351008+0000) 2021-08-03T13:03:52.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:52.391+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:52.392312+0000) 2021-08-03T13:03:52.414 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:03:52.408+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:52.409658+0000) 2021-08-03T13:03:52.415 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:52.410+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:52.411746+0000) 2021-08-03T13:03:52.417 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:52.412+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:52.413766+0000) 2021-08-03T13:03:52.633 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:52.350+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4095 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:53.293 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:53.288+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:53.289600+0000) 2021-08-03T13:03:53.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:53.391+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:53.392440+0000) 2021-08-03T13:03:53.415 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:53.411+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:53.411955+0000) 2021-08-03T13:03:53.417 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:53.413+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:53.413901+0000) 2021-08-03T13:03:54.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:54.391+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:54.392579+0000) 2021-08-03T13:03:54.415 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:54.411+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:54.412071+0000) 2021-08-03T13:03:54.724 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:54.718+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:54.719414+0000) 2021-08-03T13:03:54.874 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:03:54.849+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9085 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:03:54.945 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:03:54.937+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:54.938607+0000) 2021-08-03T13:03:55.187 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:55.182+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:55.183580+0000) 2021-08-03T13:03:55.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:55.391+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:55.392717+0000) 2021-08-03T13:03:55.505 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:03:55.499+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:03:56.002 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:55.996+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:55.997609+0000) 2021-08-03T13:03:56.173 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:56.168+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:56.168957+0000) 2021-08-03T13:03:56.475 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:03:56.470+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:56.471609+0000) 2021-08-03T13:03:57.003 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:56.997+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:56.998431+0000) 2021-08-03T13:03:57.653 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:03:57.644+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:57.645734+0000) 2021-08-03T13:03:57.851 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:57.846+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:57.847357+0000) 2021-08-03T13:03:57.951 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:57.945+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:57.946091+0000) 2021-08-03T13:03:58.003 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:57.998+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:57.998993+0000) 2021-08-03T13:03:58.278 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:58.273+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:58.274679+0000) 2021-08-03T13:03:58.952 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:58.946+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:58.947098+0000) 2021-08-03T13:03:58.984 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:03:58.978+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:58.979469+0000) 2021-08-03T13:03:59.006 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:58.998+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:58.999548+0000) 2021-08-03T13:03:59.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:59.153+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:59.154484+0000) 2021-08-03T13:03:59.168 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:03:59.056+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4095 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:03:59.278 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:03:59.274+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:59.274806+0000) 2021-08-03T13:03:59.953 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:03:59.947+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:03:59.947932+0000) 2021-08-03T13:04:00.005 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:03:59.999+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:00.000233+0000) 2021-08-03T13:04:00.279 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:00.274+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:00.274936+0000) 2021-08-03T13:04:00.434 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:00.428+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:00.429579+0000) 2021-08-03T13:04:00.632 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:00.534+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9109 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:00.890 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:04:00.883+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:00.884715+0000) 2021-08-03T13:04:01.435 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:01.429+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:01.430275+0000) 2021-08-03T13:04:02.436 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:02.430+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:02.430918+0000) 2021-08-03T13:04:03.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:03.126+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:03.127412+0000) 2021-08-03T13:04:03.436 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:03.430+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:03.431528+0000) 2021-08-03T13:04:03.909 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:03.779+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9567 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:04.072 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:04.066+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.067224+0000) 2021-08-03T13:04:04.080 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:04.074+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.075227+0000) 2021-08-03T13:04:04.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:04.414+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.415025+0000) 2021-08-03T13:04:04.436 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:04.431+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.432169+0000) 2021-08-03T13:04:04.576 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:04.568+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.569338+0000) 2021-08-03T13:04:04.612 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:04.605+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.606001+0000) 2021-08-03T13:04:04.758 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:04.751+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.752586+0000) 2021-08-03T13:04:04.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:04.905+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:04.906484+0000) 2021-08-03T13:04:05.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:05.414+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:05.415188+0000) 2021-08-03T13:04:05.437 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:05.432+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:05.432776+0000) 2021-08-03T13:04:06.079 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:06.074+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:06.075235+0000) 2021-08-03T13:04:06.132 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:06.127+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:06.128521+0000) 2021-08-03T13:04:06.194 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:05.859+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4098 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:06.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:06.414+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:06.415340+0000) 2021-08-03T13:04:06.438 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:06.432+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:06.433653+0000) 2021-08-03T13:04:06.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:06.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:06.518081+0000) 2021-08-03T13:04:06.551 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:06.544+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:06.544958+0000) 2021-08-03T13:04:07.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:07.414+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:07.415490+0000) 2021-08-03T13:04:07.438 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:07.433+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:07.434286+0000) 2021-08-03T13:04:07.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:07.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:07.518185+0000) 2021-08-03T13:04:07.554 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:07.549+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:07.550219+0000) 2021-08-03T13:04:08.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:08.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:08.518322+0000) 2021-08-03T13:04:08.660 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:08.613+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9119 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:09.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:09.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:09.518447+0000) 2021-08-03T13:04:10.404 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:10.399+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:10.400180+0000) 2021-08-03T13:04:10.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:10.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:10.518593+0000) 2021-08-03T13:04:10.670 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:10.664+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:10.665027+0000) 2021-08-03T13:04:10.677 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:10.670+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:10.671205+0000) 2021-08-03T13:04:10.778 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:10.724+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9571 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:11.047 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:11.040+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:11.042278+0000) 2021-08-03T13:04:11.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:11.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:11.518717+0000) 2021-08-03T13:04:11.604 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:11.574+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4100 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:12.171 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:12.163+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:12.165058+0000) 2021-08-03T13:04:12.292 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:12.287+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:12.287920+0000) 2021-08-03T13:04:12.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:12.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:12.518855+0000) 2021-08-03T13:04:12.618 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:12.612+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:12.612862+0000) 2021-08-03T13:04:13.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:13.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:13.518983+0000) 2021-08-03T13:04:13.655 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:13.647+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:13.649536+0000) 2021-08-03T13:04:13.656 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:04:13.649+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:13.651453+0000) 2021-08-03T13:04:13.918 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:13.729+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9142 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:13.939 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:13.933+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:13.934377+0000) 2021-08-03T13:04:14.285 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:14.280+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:14.281380+0000) 2021-08-03T13:04:15.191 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:15.184+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:15.185885+0000) 2021-08-03T13:04:15.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:15.225+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:15.226712+0000) 2021-08-03T13:04:15.893 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:15.888+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:15.889104+0000) 2021-08-03T13:04:16.484 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:16.476+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:16.478799+0000) 2021-08-03T13:04:16.564 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:16.558+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:16.558900+0000) 2021-08-03T13:04:16.692 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:16.687+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:16.688236+0000) 2021-08-03T13:04:17.004 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:16.840+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9573 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:17.127 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:17.121+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:17.122852+0000) 2021-08-03T13:04:17.269 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:17.263+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:17.265463+0000) 2021-08-03T13:04:17.693 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:17.688+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:17.688746+0000) 2021-08-03T13:04:17.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:17.769+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:17.770288+0000) 2021-08-03T13:04:18.127 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:18.122+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:18.123419+0000) 2021-08-03T13:04:18.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:18.540+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:18.540882+0000) 2021-08-03T13:04:18.694 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:18.688+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:18.689344+0000) 2021-08-03T13:04:19.128 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:19.123+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:19.124012+0000) 2021-08-03T13:04:19.477 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:19.471+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:19.471818+0000) 2021-08-03T13:04:19.544 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:19.540+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:19.541045+0000) 2021-08-03T13:04:19.696 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:19.690+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:19.691687+0000) 2021-08-03T13:04:20.130 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:20.124+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:20.124802+0000) 2021-08-03T13:04:20.697 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:20.691+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:20.692586+0000) 2021-08-03T13:04:21.032 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:20.756+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4107 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:21.222 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:21.217+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:21.218645+0000) 2021-08-03T13:04:21.367 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:21.313+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9161 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:21.434 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:21.429+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:21.430481+0000) 2021-08-03T13:04:21.698 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:21.692+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:21.693534+0000) 2021-08-03T13:04:21.798 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:21.793+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:21.794153+0000) 2021-08-03T13:04:22.209 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:22.203+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:22.203928+0000) 2021-08-03T13:04:22.240 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:22.235+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:22.236771+0000) 2021-08-03T13:04:22.563 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:22.556+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:22.556990+0000) 2021-08-03T13:04:22.870 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:22.863+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:22.864637+0000) 2021-08-03T13:04:23.419 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:23.414+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:23.415843+0000) 2021-08-03T13:04:23.511 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:23.504+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:23.505748+0000) 2021-08-03T13:04:23.561 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:23.530+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9573 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:24.060 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:24.054+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:24.056562+0000) 2021-08-03T13:04:24.422 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:24.416+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:24.418500+0000) 2021-08-03T13:04:24.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:24.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:24.644422+0000) 2021-08-03T13:04:24.917 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:24.909+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:24.911624+0000) 2021-08-03T13:04:24.963 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:24.959+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:24.960183+0000) 2021-08-03T13:04:25.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:25.054+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:25.056727+0000) 2021-08-03T13:04:25.254 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:04:25.247+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:25.248324+0000) 2021-08-03T13:04:25.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:25.249+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:25.251383+0000) 2021-08-03T13:04:25.425 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:25.419+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:25.421099+0000) 2021-08-03T13:04:25.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:25.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:25.644549+0000) 2021-08-03T13:04:25.827 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:25.819+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:25.821608+0000) 2021-08-03T13:04:25.864 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:25.837+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4113 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:26.060 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:26.055+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:26.056852+0000) 2021-08-03T13:04:26.315 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:26.309+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:26.311505+0000) 2021-08-03T13:04:26.319 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:26.313+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:26.315505+0000) 2021-08-03T13:04:26.427 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:26.422+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:26.423967+0000) 2021-08-03T13:04:26.446 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:26.439+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:26.441536+0000) 2021-08-03T13:04:26.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:26.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:26.644690+0000) 2021-08-03T13:04:27.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:27.055+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:27.056989+0000) 2021-08-03T13:04:27.125 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:27.119+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:27.121457+0000) 2021-08-03T13:04:27.430 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:27.424+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:27.426564+0000) 2021-08-03T13:04:27.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:27.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:27.644796+0000) 2021-08-03T13:04:27.747 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:27.740+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:27.742435+0000) 2021-08-03T13:04:28.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:28.055+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:28.057139+0000) 2021-08-03T13:04:28.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:28.426+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:28.428563+0000) 2021-08-03T13:04:28.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:28.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:28.644966+0000) 2021-08-03T13:04:28.890 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:28.865+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9179 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:29.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:29.055+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:29.057268+0000) 2021-08-03T13:04:29.079 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:29.072+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:29.073329+0000) 2021-08-03T13:04:29.086 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:29.079+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:29.079958+0000) 2021-08-03T13:04:29.322 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:29.316+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:29.317380+0000) 2021-08-03T13:04:29.410 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:29.403+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:29.405305+0000) 2021-08-03T13:04:29.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:29.426+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:29.428763+0000) 2021-08-03T13:04:29.831 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:04:29.825+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:29.826783+0000) 2021-08-03T13:04:30.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:30.055+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:30.057377+0000) 2021-08-03T13:04:30.959 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:30.953+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:30.954273+0000) 2021-08-03T13:04:31.010 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:31.003+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:31.005186+0000) 2021-08-03T13:04:31.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:31.055+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:31.057504+0000) 2021-08-03T13:04:31.429 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:31.421+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:31.423522+0000) 2021-08-03T13:04:31.670 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:31.664+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:31.665564+0000) 2021-08-03T13:04:31.960 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:31.954+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:31.954981+0000) 2021-08-03T13:04:32.010 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:32.005+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.005868+0000) 2021-08-03T13:04:32.039 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:32.034+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.035183+0000) 2021-08-03T13:04:32.040 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:32.035+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.036670+0000) 2021-08-03T13:04:32.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:32.056+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.057646+0000) 2021-08-03T13:04:32.121 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:32.116+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.117502+0000) 2021-08-03T13:04:32.328 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:32.322+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9573 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:32.671 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:32.666+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.667231+0000) 2021-08-03T13:04:32.887 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:32.882+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.883645+0000) 2021-08-03T13:04:32.960 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:32.954+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:32.955580+0000) 2021-08-03T13:04:33.011 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:33.005+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:33.006439+0000) 2021-08-03T13:04:33.061 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:33.056+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:33.057768+0000) 2021-08-03T13:04:33.672 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:33.666+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:33.667790+0000) 2021-08-03T13:04:33.961 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:33.955+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:33.956428+0000) 2021-08-03T13:04:34.012 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:34.006+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:34.007288+0000) 2021-08-03T13:04:34.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:34.057+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:34.057884+0000) 2021-08-03T13:04:34.673 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:34.667+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:34.668366+0000) 2021-08-03T13:04:34.961 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:34.956+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:34.957017+0000) 2021-08-03T13:04:35.012 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:35.007+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:35.007878+0000) 2021-08-03T13:04:35.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:35.057+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:35.058023+0000) 2021-08-03T13:04:35.674 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:35.668+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:35.669178+0000) 2021-08-03T13:04:35.823 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:35.818+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:35.819420+0000) 2021-08-03T13:04:35.860 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:35.855+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:35.856596+0000) 2021-08-03T13:04:35.937 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:35.798+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9183 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:35.962 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:35.957+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:35.958263+0000) 2021-08-03T13:04:36.013 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:36.007+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:36.008479+0000) 2021-08-03T13:04:36.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:36.057+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:36.058165+0000) 2021-08-03T13:04:36.085 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:36.078+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:36.079404+0000) 2021-08-03T13:04:36.468 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:36.464+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:36.464984+0000) 2021-08-03T13:04:36.675 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:36.669+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:36.670230+0000) 2021-08-03T13:04:36.963 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:36.958+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:36.959060+0000) 2021-08-03T13:04:37.013 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:37.008+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:37.009137+0000) 2021-08-03T13:04:37.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:37.057+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:37.058292+0000) 2021-08-03T13:04:37.583 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:04:37.576+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:37.577558+0000) 2021-08-03T13:04:37.626 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:37.620+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:37.620863+0000) 2021-08-03T13:04:37.675 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:37.670+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:37.670999+0000) 2021-08-03T13:04:37.759 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:37.754+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:37.755470+0000) 2021-08-03T13:04:37.964 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:37.958+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:37.959657+0000) 2021-08-03T13:04:38.014 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:38.008+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:38.009701+0000) 2021-08-03T13:04:38.062 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:38.057+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:38.058444+0000) 2021-08-03T13:04:38.166 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:38.081+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4116 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:38.676 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:38.670+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:38.671572+0000) 2021-08-03T13:04:38.964 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:38.959+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:38.960260+0000) 2021-08-03T13:04:39.094 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:39.088+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:39.089488+0000) 2021-08-03T13:04:39.362 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:39.161+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9573 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:39.554 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:39.549+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:39.550506+0000) 2021-08-03T13:04:39.593 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:39.587+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:39.587886+0000) 2021-08-03T13:04:39.676 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:39.671+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:39.672157+0000) 2021-08-03T13:04:39.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:39.769+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:39.770308+0000) 2021-08-03T13:04:40.047 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:40.040+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:40.041542+0000) 2021-08-03T13:04:40.558 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:40.553+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:40.554354+0000) 2021-08-03T13:04:40.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:40.769+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:40.770444+0000) 2021-08-03T13:04:40.984 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:40.977+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:40.978337+0000) 2021-08-03T13:04:41.081 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:40.979+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9193 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:41.086 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:41.080+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:41.081115+0000) 2021-08-03T13:04:41.561 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:41.556+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:41.557795+0000) 2021-08-03T13:04:42.874 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:42.869+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:42.870581+0000) 2021-08-03T13:04:43.001 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:42.995+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:42.995788+0000) 2021-08-03T13:04:43.348 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:43.343+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:43.344121+0000) 2021-08-03T13:04:43.534 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:43.528+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:43.528973+0000) 2021-08-03T13:04:43.558 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:43.553+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:43.554597+0000) 2021-08-03T13:04:44.154 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:44.148+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4120 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:44.202 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:44.197+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:44.198269+0000) 2021-08-03T13:04:44.391 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:44.385+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:44.386044+0000) 2021-08-03T13:04:44.418 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:44.413+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:44.414654+0000) 2021-08-03T13:04:44.527 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:04:44.520+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:44.521324+0000) 2021-08-03T13:04:44.654 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:44.647+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:44.647870+0000) 2021-08-03T13:04:45.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:45.128+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:45.129411+0000) 2021-08-03T13:04:45.418 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:45.413+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:45.414798+0000) 2021-08-03T13:04:45.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:45.853+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:45.854213+0000) 2021-08-03T13:04:46.418 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:46.414+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:46.414937+0000) 2021-08-03T13:04:46.472 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:46.466+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:46.467381+0000) 2021-08-03T13:04:46.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:46.853+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:46.854375+0000) 2021-08-03T13:04:46.909 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:46.579+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9573 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:47.165 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:47.159+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:47.160277+0000) 2021-08-03T13:04:47.418 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:47.414+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:47.415081+0000) 2021-08-03T13:04:47.849 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:47.803+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9214 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:47.858 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:47.853+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:47.854535+0000) 2021-08-03T13:04:48.393 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:04:48.387+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:48.388201+0000) 2021-08-03T13:04:49.805 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:49.748+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4124 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:49.808 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:04:49.802+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:49.803104+0000) 2021-08-03T13:04:50.063 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:04:50.057+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:50.058051+0000) 2021-08-03T13:04:50.529 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:50.521+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:50.522113+0000) 2021-08-03T13:04:50.606 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:04:50.602+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:50.602881+0000) 2021-08-03T13:04:51.136 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:51.130+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:51.130825+0000) 2021-08-03T13:04:52.136 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:52.131+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:52.131829+0000) 2021-08-03T13:04:52.158 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:52.153+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:52.154164+0000) 2021-08-03T13:04:52.281 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:52.275+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:52.276301+0000) 2021-08-03T13:04:52.562 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:52.555+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:52.556246+0000) 2021-08-03T13:04:52.701 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:52.696+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:52.696838+0000) 2021-08-03T13:04:52.773 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:52.767+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:52.767931+0000) 2021-08-03T13:04:52.839 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:52.834+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:52.835253+0000) 2021-08-03T13:04:53.137 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:53.131+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:53.132454+0000) 2021-08-03T13:04:53.702 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:53.696+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:53.697431+0000) 2021-08-03T13:04:53.918 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:04:53.909+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9228 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:04:53.920 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:53.915+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:53.916636+0000) 2021-08-03T13:04:54.138 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:54.132+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:54.132994+0000) 2021-08-03T13:04:54.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:54.245+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:54.246295+0000) 2021-08-03T13:04:54.582 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:54.577+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:54.578742+0000) 2021-08-03T13:04:55.138 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:55.132+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:55.133539+0000) 2021-08-03T13:04:55.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:55.245+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:55.246448+0000) 2021-08-03T13:04:55.403 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:04:55.284+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9573 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:04:56.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:56.245+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:56.246594+0000) 2021-08-03T13:04:56.916 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:04:56.909+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:56.910678+0000) 2021-08-03T13:04:57.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:57.245+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:57.246735+0000) 2021-08-03T13:04:57.770 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:04:57.764+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:57.764850+0000) 2021-08-03T13:04:57.940 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:04:57.934+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:57.935284+0000) 2021-08-03T13:04:58.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:58.246+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:58.246880+0000) 2021-08-03T13:04:58.465 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:04:58.161+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4134 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:04:58.631 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:04:58.624+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:58.625295+0000) 2021-08-03T13:04:58.784 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:04:58.779+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:58.780061+0000) 2021-08-03T13:04:59.580 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:04:59.574+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:04:59.575407+0000) 2021-08-03T13:05:00.375 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:00.368+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:00.369636+0000) 2021-08-03T13:05:00.449 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:00.427+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9237 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:00.496 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:00.490+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:00.491626+0000) 2021-08-03T13:05:00.912 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:00.905+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:00.906586+0000) 2021-08-03T13:05:01.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:01.066+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:01.067786+0000) 2021-08-03T13:05:01.520 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:01.515+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:01.515844+0000) 2021-08-03T13:05:02.118 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:02.113+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:02.114695+0000) 2021-08-03T13:05:02.725 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:02.719+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:02.720373+0000) 2021-08-03T13:05:02.873 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:02.535+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:03.473 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:03.468+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:03.469722+0000) 2021-08-03T13:05:04.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:04.041+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:04.042405+0000) 2021-08-03T13:05:04.147 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:04.116+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4139 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:05.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:05.041+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:05.042570+0000) 2021-08-03T13:05:05.796 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:05.790+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:05.791201+0000) 2021-08-03T13:05:06.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:06.041+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:06.042698+0000) 2021-08-03T13:05:06.826 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:06.820+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:06.820951+0000) 2021-08-03T13:05:07.047 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:07.042+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:07.042833+0000) 2021-08-03T13:05:07.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:07.082+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:07.083556+0000) 2021-08-03T13:05:07.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:07.872+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:07.873653+0000) 2021-08-03T13:05:08.047 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:08.042+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:08.042997+0000) 2021-08-03T13:05:08.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:08.082+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:08.083667+0000) 2021-08-03T13:05:08.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:08.875+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:08.876258+0000) 2021-08-03T13:05:09.020 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:09.014+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:09.015163+0000) 2021-08-03T13:05:09.047 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:09.042+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:09.043155+0000) 2021-08-03T13:05:09.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:09.082+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:09.083796+0000) 2021-08-03T13:05:09.883 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:09.878+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:09.879758+0000) 2021-08-03T13:05:09.970 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:09.964+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:09.965605+0000) 2021-08-03T13:05:10.020 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:10.015+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:10.016107+0000) 2021-08-03T13:05:10.047 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:10.042+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:10.043296+0000) 2021-08-03T13:05:10.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:10.083+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:10.083938+0000) 2021-08-03T13:05:10.683 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:10.677+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:10.677924+0000) 2021-08-03T13:05:10.886 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:10.881+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:10.882570+0000) 2021-08-03T13:05:10.970 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:10.965+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:10.966363+0000) 2021-08-03T13:05:10.998 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:10.958+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9286 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:11.047 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:11.042+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:11.043490+0000) 2021-08-03T13:05:11.631 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:11.625+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:11.626927+0000) 2021-08-03T13:05:11.886 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:11.880+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:11.882723+0000) 2021-08-03T13:05:11.971 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:11.966+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:11.966966+0000) 2021-08-03T13:05:12.079 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:11.965+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:12.162 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:12.155+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:12.157252+0000) 2021-08-03T13:05:12.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:12.633+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:12.635048+0000) 2021-08-03T13:05:12.645 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:12.640+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:12.641393+0000) 2021-08-03T13:05:12.889 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:12.883+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:12.885237+0000) 2021-08-03T13:05:13.132 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:13.126+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4139 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:13.133 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:13.127+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:13.129713+0000) 2021-08-03T13:05:13.154 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:13.147+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:13.149159+0000) 2021-08-03T13:05:13.892 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:13.886+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:13.887867+0000) 2021-08-03T13:05:14.273 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:14.266+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:14.267512+0000) 2021-08-03T13:05:14.438 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:14.432+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:14.434772+0000) 2021-08-03T13:05:14.894 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:14.888+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:14.889964+0000) 2021-08-03T13:05:15.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:15.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:15.434925+0000) 2021-08-03T13:05:15.565 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:15.559+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:15.561602+0000) 2021-08-03T13:05:15.598 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:15.591+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:15.592228+0000) 2021-08-03T13:05:15.601 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:15.594+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:15.595186+0000) 2021-08-03T13:05:15.894 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:15.888+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:15.890085+0000) 2021-08-03T13:05:16.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:16.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:16.435071+0000) 2021-08-03T13:05:16.894 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:16.888+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:16.890335+0000) 2021-08-03T13:05:17.127 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:17.120+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:17.121767+0000) 2021-08-03T13:05:17.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:17.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:17.435226+0000) 2021-08-03T13:05:17.541 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:17.533+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9301 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:17.590 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:17.582+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:17.584219+0000) 2021-08-03T13:05:18.172 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:18.165+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:18.167282+0000) 2021-08-03T13:05:18.186 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:18.180+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:18.439 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:18.433+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:18.435372+0000) 2021-08-03T13:05:18.537 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:18.530+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:18.531954+0000) 2021-08-03T13:05:19.172 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:19.166+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:19.167855+0000) 2021-08-03T13:05:19.230 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:19.223+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:19.224908+0000) 2021-08-03T13:05:19.239 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:19.233+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:19.235551+0000) 2021-08-03T13:05:19.840 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:19.835+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:19.836425+0000) 2021-08-03T13:05:20.174 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:20.167+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:20.168892+0000) 2021-08-03T13:05:20.448 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:20.442+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:20.442997+0000) 2021-08-03T13:05:21.174 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:21.168+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:21.169505+0000) 2021-08-03T13:05:21.432 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:21.425+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4141 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:22.175 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:22.169+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:22.170256+0000) 2021-08-03T13:05:23.175 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:23.170+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:23.170899+0000) 2021-08-03T13:05:23.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:23.194+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:23.194822+0000) 2021-08-03T13:05:23.211 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:23.203+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:23.204457+0000) 2021-08-03T13:05:24.176 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:24.170+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:24.171533+0000) 2021-08-03T13:05:24.375 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:24.370+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:24.371499+0000) 2021-08-03T13:05:24.399 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:24.393+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:25.081 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:25.046+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9307 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:25.081 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:25.076+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:25.077555+0000) 2021-08-03T13:05:25.141 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:25.134+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:25.135306+0000) 2021-08-03T13:05:26.144 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:26.138+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:26.139842+0000) 2021-08-03T13:05:26.275 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:26.271+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:26.271855+0000) 2021-08-03T13:05:26.750 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:26.742+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:26.744035+0000) 2021-08-03T13:05:27.145 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:27.139+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:27.140781+0000) 2021-08-03T13:05:27.235 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:27.230+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:27.231376+0000) 2021-08-03T13:05:27.275 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:27.271+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:27.272014+0000) 2021-08-03T13:05:27.476 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:27.469+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:27.471483+0000) 2021-08-03T13:05:27.868 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:27.862+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:27.864408+0000) 2021-08-03T13:05:27.997 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:27.991+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:27.991993+0000) 2021-08-03T13:05:28.037 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:28.031+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:28.032773+0000) 2021-08-03T13:05:28.146 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:28.139+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:28.141548+0000) 2021-08-03T13:05:28.155 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:28.146+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4147 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:28.235 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:28.230+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:28.231525+0000) 2021-08-03T13:05:28.265 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:28.259+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:28.259807+0000) 2021-08-03T13:05:28.276 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:28.271+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:28.272126+0000) 2021-08-03T13:05:28.456 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:28.450+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:28.451079+0000) 2021-08-03T13:05:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T13:05:28.767+0000 7f57d5fe5700 0 -- 172.21.15.3:0/3813029560 >> [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] conn(0x7f57b00048e0 msgr2=0x7f57b0004d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-03T13:05:29.235 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:29.230+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:29.231678+0000) 2021-08-03T13:05:29.276 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:29.271+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:29.272232+0000) 2021-08-03T13:05:29.456 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:29.451+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:29.451791+0000) 2021-08-03T13:05:29.835 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:29.828+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:29.829369+0000) 2021-08-03T13:05:30.215 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:30.161+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:30.217 INFO:teuthology.orchestra.run.smithi003.stderr:2021-08-03T13:05:30.212+0000 7f57d5fe5700 0 --2- 172.21.15.3:0/3813029560 >> [v2:172.21.15.3:3301/0,v1:172.21.15.3:6790/0] conn(0x7f57b00048e0 0x7f57b0004d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2021-08-03T13:05:30.235 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:30.231+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:30.231823+0000) 2021-08-03T13:05:30.273 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:30.266+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:30.267651+0000) 2021-08-03T13:05:30.413 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:30.406+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:30.407348+0000) 2021-08-03T13:05:30.457 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:30.451+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:30.452445+0000) 2021-08-03T13:05:31.060 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:30.956+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9328 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:31.367 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:31.362+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:31.363440+0000) 2021-08-03T13:05:31.387 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:31.381+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:31.382222+0000) 2021-08-03T13:05:31.457 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:31.452+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:31.453022+0000) 2021-08-03T13:05:32.458 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:32.452+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:32.453413+0000) 2021-08-03T13:05:32.981 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:32.976+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:32.977608+0000) 2021-08-03T13:05:33.052 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:33.046+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:33.047306+0000) 2021-08-03T13:05:33.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:33.180+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:33.180887+0000) 2021-08-03T13:05:33.458 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:33.453+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:33.453949+0000) 2021-08-03T13:05:34.159 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:34.154+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:34.155474+0000) 2021-08-03T13:05:34.405 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:34.400+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:34.401161+0000) 2021-08-03T13:05:34.459 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:34.453+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:34.454591+0000) 2021-08-03T13:05:34.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:34.622+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:34.623236+0000) 2021-08-03T13:05:35.257 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:35.251+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:35.252193+0000) 2021-08-03T13:05:35.460 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:35.454+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:35.455141+0000) 2021-08-03T13:05:35.535 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:35.410+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4151 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:35.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:35.622+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:35.623354+0000) 2021-08-03T13:05:36.413 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:36.407+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:36.408260+0000) 2021-08-03T13:05:36.460 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:36.455+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:36.455855+0000) 2021-08-03T13:05:36.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:36.622+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:36.623486+0000) 2021-08-03T13:05:37.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:37.069+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:37.070172+0000) 2021-08-03T13:05:37.410 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:37.401+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:37.627 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:37.622+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:37.623632+0000) 2021-08-03T13:05:37.663 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:37.520+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9356 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:38.504 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:38.497+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:38.498229+0000) 2021-08-03T13:05:38.961 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:38.956+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:38.957556+0000) 2021-08-03T13:05:39.326 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:39.321+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:39.322443+0000) 2021-08-03T13:05:39.543 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:39.538+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:39.539007+0000) 2021-08-03T13:05:40.466 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:40.459+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:40.460238+0000) 2021-08-03T13:05:41.026 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:41.020+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:41.021593+0000) 2021-08-03T13:05:41.243 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:41.238+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:41.239079+0000) 2021-08-03T13:05:42.027 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:42.021+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:42.022466+0000) 2021-08-03T13:05:42.626 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:42.621+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:42.621907+0000) 2021-08-03T13:05:42.994 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:42.988+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:42.988834+0000) 2021-08-03T13:05:43.028 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:43.022+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:43.023473+0000) 2021-08-03T13:05:43.148 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:43.142+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:43.142749+0000) 2021-08-03T13:05:43.459 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:43.453+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:43.453915+0000) 2021-08-03T13:05:43.568 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:43.486+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4154 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:43.627 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:43.621+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:43.622654+0000) 2021-08-03T13:05:44.024 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:44.000+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:44.156 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:44.098+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9371 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:44.161 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:44.155+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:44.156321+0000) 2021-08-03T13:05:44.436 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:44.430+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:44.431704+0000) 2021-08-03T13:05:44.628 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:44.622+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:44.623467+0000) 2021-08-03T13:05:44.916 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:44.911+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:44.912286+0000) 2021-08-03T13:05:45.479 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:05:45.473+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:45.473970+0000) 2021-08-03T13:05:45.628 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:45.623+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:45.624072+0000) 2021-08-03T13:05:46.411 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:46.403+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:46.404507+0000) 2021-08-03T13:05:46.423 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:46.418+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:46.419731+0000) 2021-08-03T13:05:46.630 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:46.624+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:46.625356+0000) 2021-08-03T13:05:47.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:47.095+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:47.096616+0000) 2021-08-03T13:05:47.424 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:47.419+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:47.419896+0000) 2021-08-03T13:05:47.630 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:47.625+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:47.625972+0000) 2021-08-03T13:05:48.334 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:48.327+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:48.328594+0000) 2021-08-03T13:05:48.419 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:48.414+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:48.415752+0000) 2021-08-03T13:05:48.424 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:48.419+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:48.420042+0000) 2021-08-03T13:05:48.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:48.605+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:48.606317+0000) 2021-08-03T13:05:48.631 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:48.625+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:48.626776+0000) 2021-08-03T13:05:49.419 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:49.415+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:49.415914+0000) 2021-08-03T13:05:49.424 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:49.419+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:49.420166+0000) 2021-08-03T13:05:49.632 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:49.626+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:49.627409+0000) 2021-08-03T13:05:49.814 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:49.772+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9577 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:49.854 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:49.849+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:49.850747+0000) 2021-08-03T13:05:50.133 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:49.993+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9394 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:50.419 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:50.415+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:50.416041+0000) 2021-08-03T13:05:50.424 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:50.419+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:50.420347+0000) 2021-08-03T13:05:50.484 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:50.478+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:50.478989+0000) 2021-08-03T13:05:50.633 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:50.627+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:50.628002+0000) 2021-08-03T13:05:51.170 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:51.163+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:51.164133+0000) 2021-08-03T13:05:51.191 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:51.186+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:51.187403+0000) 2021-08-03T13:05:51.420 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:51.415+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:51.416163+0000) 2021-08-03T13:05:51.424 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:51.419+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:51.420477+0000) 2021-08-03T13:05:51.484 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:51.480+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:51.480832+0000) 2021-08-03T13:05:52.238 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:52.231+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:52.232634+0000) 2021-08-03T13:05:52.363 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:52.357+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:52.358168+0000) 2021-08-03T13:05:52.375 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:52.367+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4156 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:52.420 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:52.415+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:52.416318+0000) 2021-08-03T13:05:52.560 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:52.555+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:52.556355+0000) 2021-08-03T13:05:53.104 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:53.097+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:53.098184+0000) 2021-08-03T13:05:53.286 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:05:53.280+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:53.281187+0000) 2021-08-03T13:05:53.420 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:53.415+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:53.416464+0000) 2021-08-03T13:05:53.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:53.810+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:53.811571+0000) 2021-08-03T13:05:54.420 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:54.415+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:54.416613+0000) 2021-08-03T13:05:54.710 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:54.704+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:54.704911+0000) 2021-08-03T13:05:54.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:54.810+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:54.811741+0000) 2021-08-03T13:05:54.984 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:54.979+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:54.980561+0000) 2021-08-03T13:05:55.183 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:55.177+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:55.178114+0000) 2021-08-03T13:05:55.210 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:05:55.123+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9578 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:05:55.211 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:55.206+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:55.207605+0000) 2021-08-03T13:05:55.420 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:55.415+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:55.416742+0000) 2021-08-03T13:05:55.710 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:55.704+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:55.705591+0000) 2021-08-03T13:05:55.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:55.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:55.811887+0000) 2021-08-03T13:05:55.863 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:55.859+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:55.859799+0000) 2021-08-03T13:05:56.711 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:56.705+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:56.706368+0000) 2021-08-03T13:05:56.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:56.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:56.812049+0000) 2021-08-03T13:05:56.866 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:56.861+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:56.862327+0000) 2021-08-03T13:05:56.972 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:56.965+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:56.966175+0000) 2021-08-03T13:05:57.032 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:57.028+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:57.028988+0000) 2021-08-03T13:05:57.367 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:05:57.361+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:57.362022+0000) 2021-08-03T13:05:57.374 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:05:57.339+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9411 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:05:57.712 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:05:57.706+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:57.707157+0000) 2021-08-03T13:05:57.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:57.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:57.812181+0000) 2021-08-03T13:05:57.868 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:57.864+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:57.864888+0000) 2021-08-03T13:05:57.978 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:05:57.956+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4160 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:05:58.116 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:05:58.111+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:58.112506+0000) 2021-08-03T13:05:58.784 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:58.778+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:58.779245+0000) 2021-08-03T13:05:58.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:58.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:58.812341+0000) 2021-08-03T13:05:58.871 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:58.866+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:58.867001+0000) 2021-08-03T13:05:59.057 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:05:59.050+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:59.051775+0000) 2021-08-03T13:05:59.151 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:05:59.146+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:59.146834+0000) 2021-08-03T13:05:59.519 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:05:59.512+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:59.513251+0000) 2021-08-03T13:05:59.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:59.810+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:59.812488+0000) 2021-08-03T13:05:59.851 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:05:59.844+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:59.844931+0000) 2021-08-03T13:05:59.871 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:59.865+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:59.867137+0000) 2021-08-03T13:05:59.981 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:05:59.976+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:05:59.977907+0000) 2021-08-03T13:06:00.152 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:00.147+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:00.148012+0000) 2021-08-03T13:06:00.262 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:00.256+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:00.256911+0000) 2021-08-03T13:06:00.460 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:00.452+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9581 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:00.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:00.810+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:00.812624+0000) 2021-08-03T13:06:00.871 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:00.865+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:00.867345+0000) 2021-08-03T13:06:01.158 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:01.151+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:01.151983+0000) 2021-08-03T13:06:01.536 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:06:01.529+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:01.531102+0000) 2021-08-03T13:06:01.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:01.810+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:01.812744+0000) 2021-08-03T13:06:02.157 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:02.151+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:02.152511+0000) 2021-08-03T13:06:02.778 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:02.772+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:02.774598+0000) 2021-08-03T13:06:02.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:02.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:02.812855+0000) 2021-08-03T13:06:03.158 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:03.152+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:03.153156+0000) 2021-08-03T13:06:03.304 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:03.298+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:03.300354+0000) 2021-08-03T13:06:03.429 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:03.359+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9419 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:03.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:03.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:03.812995+0000) 2021-08-03T13:06:04.158 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:04.153+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:04.153758+0000) 2021-08-03T13:06:04.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:04.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:04.813100+0000) 2021-08-03T13:06:04.904 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:04.900+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:04.901044+0000) 2021-08-03T13:06:05.159 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:05.153+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:05.154561+0000) 2021-08-03T13:06:05.179 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:05.173+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:05.175594+0000) 2021-08-03T13:06:05.370 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:05.194+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4170 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:05.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:05.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:05.813230+0000) 2021-08-03T13:06:06.159 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:06.154+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:06.155153+0000) 2021-08-03T13:06:06.213 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:06.202+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:06.203774+0000) 2021-08-03T13:06:06.708 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:06.687+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9597 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:06.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:06.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:06.813357+0000) 2021-08-03T13:06:07.127 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:07.120+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:07.121294+0000) 2021-08-03T13:06:07.159 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:07.154+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:07.155716+0000) 2021-08-03T13:06:07.465 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:07.458+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:07.460082+0000) 2021-08-03T13:06:07.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:07.783+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:07.785012+0000) 2021-08-03T13:06:07.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:07.811+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:07.813491+0000) 2021-08-03T13:06:08.024 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:08.017+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:08.018266+0000) 2021-08-03T13:06:08.160 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:08.155+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:08.156086+0000) 2021-08-03T13:06:08.465 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:08.459+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:08.460937+0000) 2021-08-03T13:06:08.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:08.812+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:08.813647+0000) 2021-08-03T13:06:08.964 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:08.958+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:08.959568+0000) 2021-08-03T13:06:09.161 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:09.155+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:09.156748+0000) 2021-08-03T13:06:09.466 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:09.460+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:09.461538+0000) 2021-08-03T13:06:09.476 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:09.337+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9422 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:09.550 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:09.545+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:09.546672+0000) 2021-08-03T13:06:09.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:09.812+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:09.813784+0000) 2021-08-03T13:06:10.163 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:10.158+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:10.158982+0000) 2021-08-03T13:06:10.467 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:10.461+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:10.462149+0000) 2021-08-03T13:06:10.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:10.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:10.813914+0000) 2021-08-03T13:06:11.164 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:11.158+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:11.159556+0000) 2021-08-03T13:06:11.467 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:11.462+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:11.462760+0000) 2021-08-03T13:06:11.698 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:11.693+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:11.694000+0000) 2021-08-03T13:06:11.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:11.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:11.814067+0000) 2021-08-03T13:06:11.986 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:11.982+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:11.982843+0000) 2021-08-03T13:06:12.164 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:12.159+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:12.160094+0000) 2021-08-03T13:06:12.293 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:12.118+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4183 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:12.420 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:12.364+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9606 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:12.468 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:12.462+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:12.463385+0000) 2021-08-03T13:06:12.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:12.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:12.814202+0000) 2021-08-03T13:06:12.985 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:12.979+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:12.980520+0000) 2021-08-03T13:06:13.264 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:13.256+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:13.257225+0000) 2021-08-03T13:06:13.469 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:13.463+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:13.463988+0000) 2021-08-03T13:06:13.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:13.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:13.814339+0000) 2021-08-03T13:06:13.985 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:13.980+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:13.981265+0000) 2021-08-03T13:06:14.036 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:14.028+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:14.029311+0000) 2021-08-03T13:06:14.421 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:14.416+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:14.417423+0000) 2021-08-03T13:06:14.469 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:14.463+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:14.464622+0000) 2021-08-03T13:06:14.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:14.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:14.814477+0000) 2021-08-03T13:06:14.986 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:14.981+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:14.981869+0000) 2021-08-03T13:06:15.144 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:15.139+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:15.140762+0000) 2021-08-03T13:06:15.470 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:15.464+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:15.465250+0000) 2021-08-03T13:06:15.818 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:15.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:15.814603+0000) 2021-08-03T13:06:15.987 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:15.981+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:15.982726+0000) 2021-08-03T13:06:16.232 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:16.225+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:16.226180+0000) 2021-08-03T13:06:16.453 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:16.446+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:16.447213+0000) 2021-08-03T13:06:16.470 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:16.465+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:16.465844+0000) 2021-08-03T13:06:16.819 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:16.813+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:16.814783+0000) 2021-08-03T13:06:16.988 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:16.982+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:16.983349+0000) 2021-08-03T13:06:17.264 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:17.258+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9434 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:17.471 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:17.465+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:17.466500+0000) 2021-08-03T13:06:17.475 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:17.468+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:17.469467+0000) 2021-08-03T13:06:17.988 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:17.983+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:17.983957+0000) 2021-08-03T13:06:18.294 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:18.288+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:18.289185+0000) 2021-08-03T13:06:18.352 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:18.326+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9614 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:18.472 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:18.466+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:18.467290+0000) 2021-08-03T13:06:18.994 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:18.983+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:18.984546+0000) 2021-08-03T13:06:19.222 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:19.086+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4183 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:19.472 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:19.467+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:19.467908+0000) 2021-08-03T13:06:19.972 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:19.966+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:19.966953+0000) 2021-08-03T13:06:19.989 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:19.984+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:19.985127+0000) 2021-08-03T13:06:20.035 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:20.030+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:20.031216+0000) 2021-08-03T13:06:20.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:20.412+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:20.413107+0000) 2021-08-03T13:06:20.473 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:20.467+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:20.468534+0000) 2021-08-03T13:06:20.514 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:20.509+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:20.510572+0000) 2021-08-03T13:06:20.990 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:20.984+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:20.985738+0000) 2021-08-03T13:06:21.325 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:21.319+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:21.319844+0000) 2021-08-03T13:06:21.416 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:21.410+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:21.410941+0000) 2021-08-03T13:06:21.474 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:21.468+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:21.469185+0000) 2021-08-03T13:06:21.639 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:21.634+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:21.635073+0000) 2021-08-03T13:06:21.990 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:21.985+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:21.986319+0000) 2021-08-03T13:06:22.074 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:22.069+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:22.070342+0000) 2021-08-03T13:06:22.474 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:22.469+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:22.469756+0000) 2021-08-03T13:06:22.640 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:22.634+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:22.635675+0000) 2021-08-03T13:06:22.992 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:22.986+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:22.986938+0000) 2021-08-03T13:06:23.475 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:23.469+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:23.470367+0000) 2021-08-03T13:06:23.641 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:23.635+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:23.636522+0000) 2021-08-03T13:06:23.992 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:23.987+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:23.987976+0000) 2021-08-03T13:06:24.008 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:24.003+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9444 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:24.475 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:24.470+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:24.470924+0000) 2021-08-03T13:06:24.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:24.564+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:24.565166+0000) 2021-08-03T13:06:24.642 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:24.636+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:24.637428+0000) 2021-08-03T13:06:24.899 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:24.892+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:24.893367+0000) 2021-08-03T13:06:24.993 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:24.988+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:24.988945+0000) 2021-08-03T13:06:25.206 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:25.200+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:25.200755+0000) 2021-08-03T13:06:25.291 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:25.185+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9625 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:25.476 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:25.470+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:25.471511+0000) 2021-08-03T13:06:25.995 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:25.989+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:25.990256+0000) 2021-08-03T13:06:26.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:26.083+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.084549+0000) 2021-08-03T13:06:26.235 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:26.230+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.231735+0000) 2021-08-03T13:06:26.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:26.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.417127+0000) 2021-08-03T13:06:26.476 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:26.471+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.472149+0000) 2021-08-03T13:06:26.521 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:26.516+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.517634+0000) 2021-08-03T13:06:26.596 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:26.357+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4188 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:26.712 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:26.705+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.706078+0000) 2021-08-03T13:06:26.937 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:26.931+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.931882+0000) 2021-08-03T13:06:26.995 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:26.990+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:26.990894+0000) 2021-08-03T13:06:27.421 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:27.416+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:27.416903+0000) 2021-08-03T13:06:27.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:27.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:27.417258+0000) 2021-08-03T13:06:27.477 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:27.471+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:27.472741+0000) 2021-08-03T13:06:27.996 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:27.990+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:27.991541+0000) 2021-08-03T13:06:28.391 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:28.384+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:28.385243+0000) 2021-08-03T13:06:28.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:28.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:28.417393+0000) 2021-08-03T13:06:28.851 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:28.844+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:28.845476+0000) 2021-08-03T13:06:29.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:29.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:29.417526+0000) 2021-08-03T13:06:30.094 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:30.088+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:30.088976+0000) 2021-08-03T13:06:30.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:30.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:30.417667+0000) 2021-08-03T13:06:30.690 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:30.603+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9449 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:31.179 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:06:31.172+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:31.173039+0000) 2021-08-03T13:06:31.315 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:31.309+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:31.310465+0000) 2021-08-03T13:06:31.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:31.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:31.417806+0000) 2021-08-03T13:06:31.483 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:31.478+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:31.479761+0000) 2021-08-03T13:06:31.677 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:31.654+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9637 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:32.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:32.417+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:32.417945+0000) 2021-08-03T13:06:33.330 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:33.324+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:33.324819+0000) 2021-08-03T13:06:33.421 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:33.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:33.418065+0000) 2021-08-03T13:06:33.569 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:33.564+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:33.565287+0000) 2021-08-03T13:06:34.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:34.334+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:34.335512+0000) 2021-08-03T13:06:34.422 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:34.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:34.418211+0000) 2021-08-03T13:06:34.491 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:34.483+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:34.484603+0000) 2021-08-03T13:06:34.678 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:34.671+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:34.673119+0000) 2021-08-03T13:06:34.705 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:34.698+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4194 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:35.175 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:35.170+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:35.171682+0000) 2021-08-03T13:06:35.180 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:35.173+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:35.175241+0000) 2021-08-03T13:06:35.362 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:35.355+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:35.356344+0000) 2021-08-03T13:06:35.422 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:35.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:35.418352+0000) 2021-08-03T13:06:35.760 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:35.753+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:35.754839+0000) 2021-08-03T13:06:36.422 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:36.416+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:36.418479+0000) 2021-08-03T13:06:37.423 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:37.118+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9467 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:37.567 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:37.562+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:37.563655+0000) 2021-08-03T13:06:37.589 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:37.583+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:37.585469+0000) 2021-08-03T13:06:38.219 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:38.211+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:38.213330+0000) 2021-08-03T13:06:38.245 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:38.241+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:38.241808+0000) 2021-08-03T13:06:38.292 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:38.288+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:38.288915+0000) 2021-08-03T13:06:38.445 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:38.367+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9641 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:39.019 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:39.013+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:39.014216+0000) 2021-08-03T13:06:39.035 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:06:39.029+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:39.030028+0000) 2021-08-03T13:06:39.315 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:39.308+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:39.310119+0000) 2021-08-03T13:06:39.450 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:39.446+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:39.446975+0000) 2021-08-03T13:06:39.524 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:39.518+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:39.519093+0000) 2021-08-03T13:06:40.437 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:40.432+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:40.433697+0000) 2021-08-03T13:06:40.443 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:40.436+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:40.438492+0000) 2021-08-03T13:06:41.303 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:41.296+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:41.297391+0000) 2021-08-03T13:06:41.648 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:41.642+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:41.642749+0000) 2021-08-03T13:06:41.815 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:41.809+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:41.810484+0000) 2021-08-03T13:06:42.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:42.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:42.440854+0000) 2021-08-03T13:06:42.704 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:42.698+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:42.699467+0000) 2021-08-03T13:06:42.815 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:42.810+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:42.811170+0000) 2021-08-03T13:06:43.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:43.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:43.441014+0000) 2021-08-03T13:06:43.704 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:43.699+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:43.700222+0000) 2021-08-03T13:06:43.707 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:43.480+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:43.817 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:43.811+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:43.811776+0000) 2021-08-03T13:06:44.037 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:44.031+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:44.031910+0000) 2021-08-03T13:06:44.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:44.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:44.441141+0000) 2021-08-03T13:06:44.446 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:44.130+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9475 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:44.706 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:44.700+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:44.701183+0000) 2021-08-03T13:06:45.037 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:45.032+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:45.032777+0000) 2021-08-03T13:06:45.303 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:45.298+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:45.299431+0000) 2021-08-03T13:06:45.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:45.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:45.441273+0000) 2021-08-03T13:06:45.553 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:45.425+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9652 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:45.706 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:45.701+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:45.701993+0000) 2021-08-03T13:06:45.873 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:45.868+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:45.869437+0000) 2021-08-03T13:06:46.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:46.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:46.441428+0000) 2021-08-03T13:06:46.707 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:46.701+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:46.702619+0000) 2021-08-03T13:06:46.840 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:46.834+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:46.835091+0000) 2021-08-03T13:06:46.890 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:06:46.884+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:46.885242+0000) 2021-08-03T13:06:47.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:47.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:47.441561+0000) 2021-08-03T13:06:47.626 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:47.619+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:47.620729+0000) 2021-08-03T13:06:47.708 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:47.702+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:47.703470+0000) 2021-08-03T13:06:48.429 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:48.423+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:48.424109+0000) 2021-08-03T13:06:48.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:48.439+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:48.441680+0000) 2021-08-03T13:06:48.556 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:48.548+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:48.550665+0000) 2021-08-03T13:06:48.708 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:48.703+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:48.704012+0000) 2021-08-03T13:06:49.001 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:48.994+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:48.995485+0000) 2021-08-03T13:06:49.027 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:49.021+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:49.022419+0000) 2021-08-03T13:06:49.127 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:49.123+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:49.123939+0000) 2021-08-03T13:06:49.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:49.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:49.441843+0000) 2021-08-03T13:06:49.709 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:49.703+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:49.704640+0000) 2021-08-03T13:06:50.001 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:49.995+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:49.996481+0000) 2021-08-03T13:06:50.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:50.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:50.442000+0000) 2021-08-03T13:06:50.509 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:50.502+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:50.503991+0000) 2021-08-03T13:06:50.542 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:49.757+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:50.711 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:50.705+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:50.706632+0000) 2021-08-03T13:06:51.001 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:50.996+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:50.997139+0000) 2021-08-03T13:06:51.051 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:51.045+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:51.046960+0000) 2021-08-03T13:06:51.439 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:51.432+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:51.433724+0000) 2021-08-03T13:06:51.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:51.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:51.442112+0000) 2021-08-03T13:06:51.473 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:51.312+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9491 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:51.711 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:51.688+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9663 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:51.712 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:51.706+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:51.707576+0000) 2021-08-03T13:06:52.007 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:52.000+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:52.001705+0000) 2021-08-03T13:06:52.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:52.099+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:52.100837+0000) 2021-08-03T13:06:52.189 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:52.183+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:52.185731+0000) 2021-08-03T13:06:52.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:52.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:52.442252+0000) 2021-08-03T13:06:52.713 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:52.707+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:52.708379+0000) 2021-08-03T13:06:53.047 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:53.040+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:53.042126+0000) 2021-08-03T13:06:53.338 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:53.333+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:53.334222+0000) 2021-08-03T13:06:53.370 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:06:53.363+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:53.364985+0000) 2021-08-03T13:06:53.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:53.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:53.442419+0000) 2021-08-03T13:06:53.713 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:53.708+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:53.709106+0000) 2021-08-03T13:06:53.749 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:06:53.742+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:53.743590+0000) 2021-08-03T13:06:54.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:54.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:54.442561+0000) 2021-08-03T13:06:54.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:54.647+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:54.649242+0000) 2021-08-03T13:06:54.714 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:54.708+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:54.709699+0000) 2021-08-03T13:06:54.851 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:06:54.843+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:54.844963+0000) 2021-08-03T13:06:55.286 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:06:55.182+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:06:55.446 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:55.440+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:55.442733+0000) 2021-08-03T13:06:55.585 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:55.579+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:55.580745+0000) 2021-08-03T13:06:55.649 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:55.643+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:55.644415+0000) 2021-08-03T13:06:55.656 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:55.649+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:55.651807+0000) 2021-08-03T13:06:55.715 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:55.709+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:55.710519+0000) 2021-08-03T13:06:56.190 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:56.183+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:56.185574+0000) 2021-08-03T13:06:56.422 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:56.417+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:56.418804+0000) 2021-08-03T13:06:56.447 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:56.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:56.442886+0000) 2021-08-03T13:06:56.650 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:56.644+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:56.645526+0000) 2021-08-03T13:06:56.659 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:56.653+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:56.655334+0000) 2021-08-03T13:06:56.715 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:56.710+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:56.711182+0000) 2021-08-03T13:06:57.191 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:57.184+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:57.186572+0000) 2021-08-03T13:06:57.422 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:57.418+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:57.418941+0000) 2021-08-03T13:06:57.447 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:57.441+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:57.443033+0000) 2021-08-03T13:06:57.650 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:57.645+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:57.646116+0000) 2021-08-03T13:06:57.661 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:57.656+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:57.657511+0000) 2021-08-03T13:06:57.717 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:57.711+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:57.712620+0000) 2021-08-03T13:06:58.155 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:06:58.149+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:58.150436+0000) 2021-08-03T13:06:58.192 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:58.186+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:58.187136+0000) 2021-08-03T13:06:58.422 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:06:58.418+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:58.419092+0000) 2021-08-03T13:06:58.651 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:06:58.645+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:58.646735+0000) 2021-08-03T13:06:58.717 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:58.712+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:58.713595+0000) 2021-08-03T13:06:58.719 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:06:58.713+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:58.714662+0000) 2021-08-03T13:06:58.747 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:06:58.741+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9678 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:06:58.843 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:06:58.819+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9491 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:06:58.926 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:58.921+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:58.922380+0000) 2021-08-03T13:06:59.192 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:06:59.186+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:59.187662+0000) 2021-08-03T13:06:59.264 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:59.259+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:59.260553+0000) 2021-08-03T13:06:59.383 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:06:59.377+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:59.378523+0000) 2021-08-03T13:06:59.719 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:06:59.713+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:59.714611+0000) 2021-08-03T13:06:59.800 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:06:59.795+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:06:59.796102+0000) 2021-08-03T13:07:00.394 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:00.389+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:00.390155+0000) 2021-08-03T13:07:00.719 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:00.714+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:00.715398+0000) 2021-08-03T13:07:00.872 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:00.865+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:00.866101+0000) 2021-08-03T13:07:01.394 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:01.389+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:01.390314+0000) 2021-08-03T13:07:01.568 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:01.563+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:01.564210+0000) 2021-08-03T13:07:01.569 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:01.563+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:01.563823+0000) 2021-08-03T13:07:01.720 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:01.715+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:01.716015+0000) 2021-08-03T13:07:01.931 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:01.925+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:01.925929+0000) 2021-08-03T13:07:01.935 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:01.929+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:01.930042+0000) 2021-08-03T13:07:02.394 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:02.389+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:02.390457+0000) 2021-08-03T13:07:02.721 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:02.716+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:02.717204+0000) 2021-08-03T13:07:02.843 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:02.838+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:02.839578+0000) 2021-08-03T13:07:02.869 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:02.863+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:02.864546+0000) 2021-08-03T13:07:03.164 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:03.153+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:03.175 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:03.169+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:03.170401+0000) 2021-08-03T13:07:03.384 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:07:03.378+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:03.379187+0000) 2021-08-03T13:07:03.394 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:03.389+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:03.390573+0000) 2021-08-03T13:07:03.723 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:03.717+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:03.718166+0000) 2021-08-03T13:07:04.175 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:04.170+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:04.171119+0000) 2021-08-03T13:07:04.177 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:04.139+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9493 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:04.245 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:04.239+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:04.240189+0000) 2021-08-03T13:07:04.386 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:04.362+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9687 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:04.623 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:04.618+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:04.619540+0000) 2021-08-03T13:07:04.723 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:04.718+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:04.719007+0000) 2021-08-03T13:07:04.917 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:04.912+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:04.913785+0000) 2021-08-03T13:07:05.197 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:05.192+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:05.193453+0000) 2021-08-03T13:07:05.478 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:05.474+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:05.474852+0000) 2021-08-03T13:07:05.483 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:05.478+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:05.479627+0000) 2021-08-03T13:07:05.724 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:05.719+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:05.720000+0000) 2021-08-03T13:07:06.197 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:06.192+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:06.193565+0000) 2021-08-03T13:07:06.725 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:06.720+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:06.720840+0000) 2021-08-03T13:07:06.912 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:06.905+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:06.905903+0000) 2021-08-03T13:07:07.197 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:07.192+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:07.193706+0000) 2021-08-03T13:07:07.726 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:07.720+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:07.721666+0000) 2021-08-03T13:07:08.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:08.193+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:08.193842+0000) 2021-08-03T13:07:08.455 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:08.449+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:08.449946+0000) 2021-08-03T13:07:08.726 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:08.721+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:08.722218+0000) 2021-08-03T13:07:09.126 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:09.119+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:09.120332+0000) 2021-08-03T13:07:09.131 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:09.126+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:09.127083+0000) 2021-08-03T13:07:09.197 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:09.193+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:09.193944+0000) 2021-08-03T13:07:09.246 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:09.241+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:09.242226+0000) 2021-08-03T13:07:09.358 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:09.352+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:09.352807+0000) 2021-08-03T13:07:09.727 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:09.721+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:09.722775+0000) 2021-08-03T13:07:10.028 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:09.871+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9503 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:10.179 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:10.174+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:10.175342+0000) 2021-08-03T13:07:10.198 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:10.193+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:10.194070+0000) 2021-08-03T13:07:10.246 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:10.241+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:10.242388+0000) 2021-08-03T13:07:10.325 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:10.306+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:10.344 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:10.184+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9706 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:10.644 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:10.640+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:10.640884+0000) 2021-08-03T13:07:10.727 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:10.722+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:10.723381+0000) 2021-08-03T13:07:10.978 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:10.971+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:10.972454+0000) 2021-08-03T13:07:11.246 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:11.241+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:11.242536+0000) 2021-08-03T13:07:11.421 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:11.414+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:11.414874+0000) 2021-08-03T13:07:11.601 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:11.594+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:11.595413+0000) 2021-08-03T13:07:11.638 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:11.632+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:11.632904+0000) 2021-08-03T13:07:11.728 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:11.723+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:11.724354+0000) 2021-08-03T13:07:12.009 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:12.004+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:12.004885+0000) 2021-08-03T13:07:12.246 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:12.241+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:12.242648+0000) 2021-08-03T13:07:12.356 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:12.351+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:12.352035+0000) 2021-08-03T13:07:12.497 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:12.491+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:12.492450+0000) 2021-08-03T13:07:12.732 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:12.724+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:12.725490+0000) 2021-08-03T13:07:13.010 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:13.004+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:13.005423+0000) 2021-08-03T13:07:13.111 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:13.103+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:13.104127+0000) 2021-08-03T13:07:13.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:13.241+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:13.242774+0000) 2021-08-03T13:07:13.498 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:13.492+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:13.493235+0000) 2021-08-03T13:07:14.010 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:14.005+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:14.005979+0000) 2021-08-03T13:07:14.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:14.242+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:14.242902+0000) 2021-08-03T13:07:14.499 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:14.493+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:14.494050+0000) 2021-08-03T13:07:15.011 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:15.005+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:15.006535+0000) 2021-08-03T13:07:15.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:15.242+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:15.243019+0000) 2021-08-03T13:07:15.499 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:15.494+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:15.494899+0000) 2021-08-03T13:07:16.012 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:16.006+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:16.007103+0000) 2021-08-03T13:07:16.042 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:16.036+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:16.037290+0000) 2021-08-03T13:07:16.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:16.242+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:16.243133+0000) 2021-08-03T13:07:16.500 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:16.494+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:16.495477+0000) 2021-08-03T13:07:17.012 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:17.007+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:17.007863+0000) 2021-08-03T13:07:17.042 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:17.037+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:17.037977+0000) 2021-08-03T13:07:17.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:17.242+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:17.243253+0000) 2021-08-03T13:07:17.500 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:17.495+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:17.496054+0000) 2021-08-03T13:07:17.608 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:17.548+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9725 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:17.926 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:17.919+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:17.920713+0000) 2021-08-03T13:07:17.948 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:17.943+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:17.944491+0000) 2021-08-03T13:07:17.985 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:17.837+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9510 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:18.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:18.242+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:18.243390+0000) 2021-08-03T13:07:18.273 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:18.268+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:18.269510+0000) 2021-08-03T13:07:18.276 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:18.269+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:18.270173+0000) 2021-08-03T13:07:18.297 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:18.073+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:18.501 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:18.496+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:18.496858+0000) 2021-08-03T13:07:18.806 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:18.802+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:18.802883+0000) 2021-08-03T13:07:19.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:19.242+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:19.243528+0000) 2021-08-03T13:07:19.435 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:19.428+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:19.429027+0000) 2021-08-03T13:07:19.623 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:19.617+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:19.618117+0000) 2021-08-03T13:07:19.795 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:19.788+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:19.789646+0000) 2021-08-03T13:07:20.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:20.242+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:20.243689+0000) 2021-08-03T13:07:20.312 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:20.307+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:20.308738+0000) 2021-08-03T13:07:21.193 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:21.186+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:21.187265+0000) 2021-08-03T13:07:21.247 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:21.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:21.243803+0000) 2021-08-03T13:07:21.622 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:21.617+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:21.617863+0000) 2021-08-03T13:07:21.632 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:21.627+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:21.628262+0000) 2021-08-03T13:07:22.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:22.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:22.243921+0000) 2021-08-03T13:07:22.623 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:22.617+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:22.618436+0000) 2021-08-03T13:07:23.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:23.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:23.244055+0000) 2021-08-03T13:07:23.625 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:23.619+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:23.620030+0000) 2021-08-03T13:07:23.954 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:23.880+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9514 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:24.175 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:24.119+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9739 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:24.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:24.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:24.244184+0000) 2021-08-03T13:07:24.626 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:24.620+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:24.621399+0000) 2021-08-03T13:07:24.757 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:24.752+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:24.753499+0000) 2021-08-03T13:07:24.768 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:24.762+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:24.762974+0000) 2021-08-03T13:07:25.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:25.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:25.244333+0000) 2021-08-03T13:07:25.627 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:25.621+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:25.622573+0000) 2021-08-03T13:07:25.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:25.693+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:25.694775+0000) 2021-08-03T13:07:25.702 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:25.695+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:25.696036+0000) 2021-08-03T13:07:25.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:25.716+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:25.717220+0000) 2021-08-03T13:07:26.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:26.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:26.244471+0000) 2021-08-03T13:07:26.435 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:26.429+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:26.430805+0000) 2021-08-03T13:07:26.628 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:26.622+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:26.623755+0000) 2021-08-03T13:07:26.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:26.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:26.694876+0000) 2021-08-03T13:07:27.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:27.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:27.244615+0000) 2021-08-03T13:07:27.376 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:27.370+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:27.370938+0000) 2021-08-03T13:07:27.519 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:27.100+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4201 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:27.629 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:27.623+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:27.624687+0000) 2021-08-03T13:07:27.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:27.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:27.694989+0000) 2021-08-03T13:07:27.743 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:27.737+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:27.738728+0000) 2021-08-03T13:07:27.817 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:27.812+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:27.812961+0000) 2021-08-03T13:07:28.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:28.243+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:28.244742+0000) 2021-08-03T13:07:28.468 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:28.463+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:28.464594+0000) 2021-08-03T13:07:28.662 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:28.657+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:28.658022+0000) 2021-08-03T13:07:28.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:28.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:28.695101+0000) 2021-08-03T13:07:29.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:29.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:29.244879+0000) 2021-08-03T13:07:29.665 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:29.660+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:29.660995+0000) 2021-08-03T13:07:29.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:29.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:29.695222+0000) 2021-08-03T13:07:29.723 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:29.717+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:29.718082+0000) 2021-08-03T13:07:29.948 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:29.941+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:29.942674+0000) 2021-08-03T13:07:30.054 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:29.702+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9524 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:30.196 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:07:30.190+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:30.191012+0000) 2021-08-03T13:07:30.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:30.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:30.245005+0000) 2021-08-03T13:07:30.479 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:30.473+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:30.474619+0000) 2021-08-03T13:07:30.668 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:30.663+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:30.663929+0000) 2021-08-03T13:07:30.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:30.694+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:30.695352+0000) 2021-08-03T13:07:30.723 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:30.717+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:30.718720+0000) 2021-08-03T13:07:31.073 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:31.066+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:31.066966+0000) 2021-08-03T13:07:31.105 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:31.099+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:31.100230+0000) 2021-08-03T13:07:31.112 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:31.061+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9749 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:31.151 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:07:31.144+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:31.145292+0000) 2021-08-03T13:07:31.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:31.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:31.245139+0000) 2021-08-03T13:07:32.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:32.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:32.245265+0000) 2021-08-03T13:07:32.960 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:32.954+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:32.955684+0000) 2021-08-03T13:07:33.196 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:33.049+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4204 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:33.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:33.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:33.245413+0000) 2021-08-03T13:07:33.282 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:33.276+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:33.277794+0000) 2021-08-03T13:07:33.535 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:33.530+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:33.531511+0000) 2021-08-03T13:07:33.872 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:33.865+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:33.866570+0000) 2021-08-03T13:07:34.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:34.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:34.245556+0000) 2021-08-03T13:07:34.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:34.390+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:34.390963+0000) 2021-08-03T13:07:34.570 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:34.564+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:34.564744+0000) 2021-08-03T13:07:35.249 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:35.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:35.245705+0000) 2021-08-03T13:07:35.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:35.390+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:35.391095+0000) 2021-08-03T13:07:35.812 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:35.647+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9528 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:36.134 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:36.129+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:36.130186+0000) 2021-08-03T13:07:36.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:36.245+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:36.245854+0000) 2021-08-03T13:07:36.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:36.390+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:36.391241+0000) 2021-08-03T13:07:36.796 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:36.790+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:36.791009+0000) 2021-08-03T13:07:37.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:37.245+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:37.245965+0000) 2021-08-03T13:07:37.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:37.390+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:37.391375+0000) 2021-08-03T13:07:37.621 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:37.323+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9764 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:38.017 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:38.011+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:38.011986+0000) 2021-08-03T13:07:38.122 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:38.116+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:38.117007+0000) 2021-08-03T13:07:38.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:38.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:38.246123+0000) 2021-08-03T13:07:38.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:38.389+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:38.391513+0000) 2021-08-03T13:07:38.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:38.443+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:38.445713+0000) 2021-08-03T13:07:38.658 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:38.350+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4204 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:38.980 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:38.970+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:38.971886+0000) 2021-08-03T13:07:39.017 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:39.011+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:39.012663+0000) 2021-08-03T13:07:39.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:39.244+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:39.246279+0000) 2021-08-03T13:07:39.395 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:39.389+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:39.391673+0000) 2021-08-03T13:07:39.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:39.444+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:39.445842+0000) 2021-08-03T13:07:40.018 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:40.012+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:40.013437+0000) 2021-08-03T13:07:40.336 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:40.330+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:40.332194+0000) 2021-08-03T13:07:40.659 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:40.652+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:40.653412+0000) 2021-08-03T13:07:40.989 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:40.984+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:40.985757+0000) 2021-08-03T13:07:41.018 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:41.013+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:41.014019+0000) 2021-08-03T13:07:41.378 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:41.372+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:41.374442+0000) 2021-08-03T13:07:41.954 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:41.930+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9531 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:42.019 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:42.013+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:42.014600+0000) 2021-08-03T13:07:42.027 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:42.021+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:42.022471+0000) 2021-08-03T13:07:43.019 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:43.014+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:43.015167+0000) 2021-08-03T13:07:43.110 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:43.104+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:43.106254+0000) 2021-08-03T13:07:43.425 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:07:43.418+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:43.420469+0000) 2021-08-03T13:07:43.544 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:43.348+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9797 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:44.020 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:44.014+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:44.015703+0000) 2021-08-03T13:07:44.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:44.358+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:44.360188+0000) 2021-08-03T13:07:44.564 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:44.557+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:44.558995+0000) 2021-08-03T13:07:44.797 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:44.789+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:44.791416+0000) 2021-08-03T13:07:45.632 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:45.505+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4206 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:45.853 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:45.847+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:45.849214+0000) 2021-08-03T13:07:46.517 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:46.511+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:46.513030+0000) 2021-08-03T13:07:47.172 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:47.167+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:47.169066+0000) 2021-08-03T13:07:47.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:47.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:47.196238+0000) 2021-08-03T13:07:47.259 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:47.252+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:47.254136+0000) 2021-08-03T13:07:47.580 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:47.573+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:47.575711+0000) 2021-08-03T13:07:47.800 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:47.794+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:47.794737+0000) 2021-08-03T13:07:48.047 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:48.042+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:48.042911+0000) 2021-08-03T13:07:48.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:48.134+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:48.135359+0000) 2021-08-03T13:07:48.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:48.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:48.196335+0000) 2021-08-03T13:07:48.248 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:48.017+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9535 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:48.288 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:48.280+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:48.282776+0000) 2021-08-03T13:07:48.657 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:48.652+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:48.653385+0000) 2021-08-03T13:07:48.661 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:48.655+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:48.656200+0000) 2021-08-03T13:07:49.048 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:49.042+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:49.043441+0000) 2021-08-03T13:07:49.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:49.134+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:49.135468+0000) 2021-08-03T13:07:49.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:49.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:49.196462+0000) 2021-08-03T13:07:49.423 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:49.417+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:49.419744+0000) 2021-08-03T13:07:50.138 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:50.130+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9819 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:50.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:50.134+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:50.135564+0000) 2021-08-03T13:07:50.804 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:07:50.798+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:50.799181+0000) 2021-08-03T13:07:51.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:51.134+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:51.135694+0000) 2021-08-03T13:07:51.150 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:07:51.143+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:51.144149+0000) 2021-08-03T13:07:51.513 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:51.508+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:51.509265+0000) 2021-08-03T13:07:51.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:51.682+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:51.683108+0000) 2021-08-03T13:07:52.000 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:07:51.979+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4209 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:07:52.069 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:07:52.062+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:52.063918+0000) 2021-08-03T13:07:52.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:52.135+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:52.135852+0000) 2021-08-03T13:07:52.389 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:52.382+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:52.383548+0000) 2021-08-03T13:07:52.392 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:07:52.386+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:52.388502+0000) 2021-08-03T13:07:52.413 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:07:52.407+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:52.408018+0000) 2021-08-03T13:07:52.452 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:52.447+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:52.448169+0000) 2021-08-03T13:07:52.846 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:52.840+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:52.841721+0000) 2021-08-03T13:07:53.029 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:53.023+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:53.024249+0000) 2021-08-03T13:07:53.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:53.135+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:53.136016+0000) 2021-08-03T13:07:53.847 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:53.841+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:53.842292+0000) 2021-08-03T13:07:54.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:54.135+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:54.136212+0000) 2021-08-03T13:07:54.223 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:07:54.156+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9540 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:07:54.848 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:54.842+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:54.843079+0000) 2021-08-03T13:07:54.904 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:54.898+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:54.899192+0000) 2021-08-03T13:07:55.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:55.135+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:55.136340+0000) 2021-08-03T13:07:55.848 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:55.842+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:55.843589+0000) 2021-08-03T13:07:55.963 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:07:55.957+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:55.958318+0000) 2021-08-03T13:07:56.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:56.392+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:56.393406+0000) 2021-08-03T13:07:56.849 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:56.843+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:56.844183+0000) 2021-08-03T13:07:56.851 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:56.846+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:56.847586+0000) 2021-08-03T13:07:56.852 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:07:56.703+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9823 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:07:57.151 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:07:57.145+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:57.146756+0000) 2021-08-03T13:07:57.850 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:07:57.844+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:57.844760+0000) 2021-08-03T13:07:59.659 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:07:59.653+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:59.654275+0000) 2021-08-03T13:07:59.816 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:07:59.810+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:07:59.810988+0000) 2021-08-03T13:08:00.084 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:08:00.077+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:00.078247+0000) 2021-08-03T13:08:00.204 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:00.198+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:00.198930+0000) 2021-08-03T13:08:00.325 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:00.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:00.321835+0000) 2021-08-03T13:08:00.659 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:00.654+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:00.654984+0000) 2021-08-03T13:08:01.204 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:01.198+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.199673+0000) 2021-08-03T13:08:01.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:01.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.321937+0000) 2021-08-03T13:08:01.338 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:01.135+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4218 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:01.453 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:01.445+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9548 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:01.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:01.451+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.451874+0000) 2021-08-03T13:08:01.660 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:01.654+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.655684+0000) 2021-08-03T13:08:01.670 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:01.665+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.666478+0000) 2021-08-03T13:08:01.719 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:01.712+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.713393+0000) 2021-08-03T13:08:01.728 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:01.722+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.723245+0000) 2021-08-03T13:08:01.760 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:01.754+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:01.755262+0000) 2021-08-03T13:08:02.205 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:02.199+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:02.200291+0000) 2021-08-03T13:08:02.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:02.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:02.322085+0000) 2021-08-03T13:08:02.661 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:02.655+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:02.656501+0000) 2021-08-03T13:08:02.672 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:02.667+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:02.668799+0000) 2021-08-03T13:08:02.729 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:02.723+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:02.723979+0000) 2021-08-03T13:08:03.109 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:03.103+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:03.104350+0000) 2021-08-03T13:08:03.174 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:03.149+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9824 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:03.177 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:03.172+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:03.173578+0000) 2021-08-03T13:08:03.205 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:03.200+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:03.200896+0000) 2021-08-03T13:08:03.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:03.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:03.322212+0000) 2021-08-03T13:08:03.662 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:03.656+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:03.657310+0000) 2021-08-03T13:08:03.675 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:03.670+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:03.671137+0000) 2021-08-03T13:08:03.729 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:03.723+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:03.724602+0000) 2021-08-03T13:08:04.206 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:04.200+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:04.201490+0000) 2021-08-03T13:08:04.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:04.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:04.322314+0000) 2021-08-03T13:08:04.345 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:04.341+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:04.341991+0000) 2021-08-03T13:08:04.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:04.672+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:04.673247+0000) 2021-08-03T13:08:04.730 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:04.724+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:04.725171+0000) 2021-08-03T13:08:05.029 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:05.024+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:05.025607+0000) 2021-08-03T13:08:05.206 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:05.201+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:05.202068+0000) 2021-08-03T13:08:05.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:05.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:05.322461+0000) 2021-08-03T13:08:05.496 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:05.490+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:05.491182+0000) 2021-08-03T13:08:05.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:05.672+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:05.673387+0000) 2021-08-03T13:08:05.730 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:05.725+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:05.725777+0000) 2021-08-03T13:08:06.030 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:06.024+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:06.025755+0000) 2021-08-03T13:08:06.191 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:06.184+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:06.185729+0000) 2021-08-03T13:08:06.207 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:06.201+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:06.202649+0000) 2021-08-03T13:08:06.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:06.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:06.322584+0000) 2021-08-03T13:08:06.677 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:06.672+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:06.673573+0000) 2021-08-03T13:08:06.731 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:06.725+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:06.726371+0000) 2021-08-03T13:08:07.030 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:07.025+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:07.025907+0000) 2021-08-03T13:08:07.208 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:07.202+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:07.203501+0000) 2021-08-03T13:08:07.285 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:07.278+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:07.279249+0000) 2021-08-03T13:08:07.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:07.321+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:07.322723+0000) 2021-08-03T13:08:07.731 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:07.726+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:07.726950+0000) 2021-08-03T13:08:08.030 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:08.025+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:08.026019+0000) 2021-08-03T13:08:08.043 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:08.003+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9548 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:08.099 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:08.091+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4224 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:08.209 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:08.203+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:08.204102+0000) 2021-08-03T13:08:08.326 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:08.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:08.322836+0000) 2021-08-03T13:08:08.482 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:08.477+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:08.478451+0000) 2021-08-03T13:08:08.732 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:08.727+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:08.727748+0000) 2021-08-03T13:08:09.081 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:09.074+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:09.075740+0000) 2021-08-03T13:08:09.209 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:09.203+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:09.204681+0000) 2021-08-03T13:08:09.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:09.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:09.322947+0000) 2021-08-03T13:08:09.733 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:09.728+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:09.728773+0000) 2021-08-03T13:08:09.990 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:09.983+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:09.984400+0000) 2021-08-03T13:08:10.132 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:09.967+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9842 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:10.156 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:10.149+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:10.150269+0000) 2021-08-03T13:08:10.210 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:10.204+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:10.205708+0000) 2021-08-03T13:08:10.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:10.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:10.323062+0000) 2021-08-03T13:08:10.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:10.324+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:10.324850+0000) 2021-08-03T13:08:10.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:10.391+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:10.391997+0000) 2021-08-03T13:08:10.734 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:10.728+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:10.729446+0000) 2021-08-03T13:08:10.864 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:10.858+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:10.859282+0000) 2021-08-03T13:08:11.212 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:11.206+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:11.207282+0000) 2021-08-03T13:08:11.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:11.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:11.323211+0000) 2021-08-03T13:08:11.735 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:11.729+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:11.730033+0000) 2021-08-03T13:08:11.864 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:11.859+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:11.860235+0000) 2021-08-03T13:08:12.213 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:12.207+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:12.207846+0000) 2021-08-03T13:08:12.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:12.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:12.323339+0000) 2021-08-03T13:08:12.445 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:12.439+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:12.440270+0000) 2021-08-03T13:08:12.735 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:12.729+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:12.730708+0000) 2021-08-03T13:08:12.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:12.809+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:12.810801+0000) 2021-08-03T13:08:12.865 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:12.860+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:12.860808+0000) 2021-08-03T13:08:13.214 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:13.208+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:13.209017+0000) 2021-08-03T13:08:13.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:13.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:13.323489+0000) 2021-08-03T13:08:13.565 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:13.416+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4233 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:13.736 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:13.730+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:13.731289+0000) 2021-08-03T13:08:13.866 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:13.860+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:13.861411+0000) 2021-08-03T13:08:14.214 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:14.208+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:14.209628+0000) 2021-08-03T13:08:14.327 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:14.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:14.323630+0000) 2021-08-03T13:08:14.736 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:14.731+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:14.731893+0000) 2021-08-03T13:08:14.867 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:14.861+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:14.862035+0000) 2021-08-03T13:08:15.215 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:15.209+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:15.210219+0000) 2021-08-03T13:08:15.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:15.322+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:15.323777+0000) 2021-08-03T13:08:15.737 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:15.731+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:15.732505+0000) 2021-08-03T13:08:15.867 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:15.861+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:15.862632+0000) 2021-08-03T13:08:16.216 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:16.210+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:16.210863+0000) 2021-08-03T13:08:16.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:16.323+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:16.323909+0000) 2021-08-03T13:08:16.737 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:16.732+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:16.733100+0000) 2021-08-03T13:08:16.843 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:16.698+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9550 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:17.119 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:17.111+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9869 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:17.216 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:17.210+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:17.211414+0000) 2021-08-03T13:08:17.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:17.323+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:17.324030+0000) 2021-08-03T13:08:17.738 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:17.732+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:17.733688+0000) 2021-08-03T13:08:17.919 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:17.914+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:17.915377+0000) 2021-08-03T13:08:17.920 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:17.915+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:17.915879+0000) 2021-08-03T13:08:17.941 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:17.934+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:17.935627+0000) 2021-08-03T13:08:18.217 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:18.211+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:18.212451+0000) 2021-08-03T13:08:18.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:18.323+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:18.324169+0000) 2021-08-03T13:08:18.587 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:18.582+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:18.583788+0000) 2021-08-03T13:08:18.739 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:18.733+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:18.734260+0000) 2021-08-03T13:08:18.855 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:08:18.849+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:18.850544+0000) 2021-08-03T13:08:19.218 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:19.212+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:19.213388+0000) 2021-08-03T13:08:19.286 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:19.279+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:19.280359+0000) 2021-08-03T13:08:19.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:19.323+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:19.324315+0000) 2021-08-03T13:08:19.739 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:19.734+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:19.734841+0000) 2021-08-03T13:08:19.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:19.750+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:19.751205+0000) 2021-08-03T13:08:20.108 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:20.101+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4234 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:20.222 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:20.213+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:20.214324+0000) 2021-08-03T13:08:20.240 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:20.233+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:20.234687+0000) 2021-08-03T13:08:20.328 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:20.323+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:20.324446+0000) 2021-08-03T13:08:20.424 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:20.419+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:20.420192+0000) 2021-08-03T13:08:20.740 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:20.734+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:20.735451+0000) 2021-08-03T13:08:20.855 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:20.850+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:20.851012+0000) 2021-08-03T13:08:22.576 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:22.571+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:22.572665+0000) 2021-08-03T13:08:22.718 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:22.674+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9565 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:22.732 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:22.726+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:22.727362+0000) 2021-08-03T13:08:22.950 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:08:22.942+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:22.943126+0000) 2021-08-03T13:08:23.194 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:23.187+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:23.188663+0000) 2021-08-03T13:08:23.376 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:23.369+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9879 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:24.145 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:24.140+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:24.141559+0000) 2021-08-03T13:08:24.227 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:24.221+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:24.221943+0000) 2021-08-03T13:08:24.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:24.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:24.824751+0000) 2021-08-03T13:08:25.017 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:25.012+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:25.013731+0000) 2021-08-03T13:08:25.540 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:25.535+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:25.536483+0000) 2021-08-03T13:08:25.576 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:25.160+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4241 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:25.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:25.824+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:25.824847+0000) 2021-08-03T13:08:26.285 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:26.279+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:26.280103+0000) 2021-08-03T13:08:26.597 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:26.591+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:26.591919+0000) 2021-08-03T13:08:26.680 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:26.675+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:26.676132+0000) 2021-08-03T13:08:26.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:26.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:26.824984+0000) 2021-08-03T13:08:27.172 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:27.166+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:27.167542+0000) 2021-08-03T13:08:27.411 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:27.404+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:27.405625+0000) 2021-08-03T13:08:27.809 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:27.802+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:27.804681+0000) 2021-08-03T13:08:27.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:27.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:27.825098+0000) 2021-08-03T13:08:28.809 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:28.803+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:28.804848+0000) 2021-08-03T13:08:28.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:28.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:28.825222+0000) 2021-08-03T13:08:28.854 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:28.830+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9569 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:29.336 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:29.262+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9884 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:29.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:29.330+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:29.332481+0000) 2021-08-03T13:08:29.654 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:29.649+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:29.649942+0000) 2021-08-03T13:08:29.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:29.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:29.825332+0000) 2021-08-03T13:08:30.318 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:30.312+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:30.314379+0000) 2021-08-03T13:08:30.335 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:30.327+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:30.329540+0000) 2021-08-03T13:08:30.829 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:30.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:30.825475+0000) 2021-08-03T13:08:30.877 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:30.870+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:30.871986+0000) 2021-08-03T13:08:30.878 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:30.871+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:30.872065+0000) 2021-08-03T13:08:30.970 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:30.870+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4241 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:30.971 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:30.963+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:30.964160+0000) 2021-08-03T13:08:31.317 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:31.310+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:31.312005+0000) 2021-08-03T13:08:31.390 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:31.384+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:31.386141+0000) 2021-08-03T13:08:31.505 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:31.498+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:31.500610+0000) 2021-08-03T13:08:31.830 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:31.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:31.825608+0000) 2021-08-03T13:08:32.089 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:32.083+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:32.084157+0000) 2021-08-03T13:08:32.830 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:32.823+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:32.825747+0000) 2021-08-03T13:08:33.555 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:33.548+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:33.550298+0000) 2021-08-03T13:08:33.694 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:08:33.686+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:33.688335+0000) 2021-08-03T13:08:33.830 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:33.824+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:33.825868+0000) 2021-08-03T13:08:34.145 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:34.139+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:34.140203+0000) 2021-08-03T13:08:34.556 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:34.549+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:34.551032+0000) 2021-08-03T13:08:34.668 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:34.662+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:34.663623+0000) 2021-08-03T13:08:34.830 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:34.824+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:34.825989+0000) 2021-08-03T13:08:35.029 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:35.023+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:35.024159+0000) 2021-08-03T13:08:35.195 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:35.189+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:35.190228+0000) 2021-08-03T13:08:35.556 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:35.551+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:35.551850+0000) 2021-08-03T13:08:35.669 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:35.664+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:35.665078+0000) 2021-08-03T13:08:35.830 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:35.824+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:35.826132+0000) 2021-08-03T13:08:36.029 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:36.024+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:36.024943+0000) 2021-08-03T13:08:36.030 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:35.990+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9890 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:36.116 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:36.006+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4241 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:36.343 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:36.338+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:36.339694+0000) 2021-08-03T13:08:36.376 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:36.371+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:36.372475+0000) 2021-08-03T13:08:36.671 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:36.055+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9573 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:36.876 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:36.870+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:36.871555+0000) 2021-08-03T13:08:37.030 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:37.024+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:37.025586+0000) 2021-08-03T13:08:37.541 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:37.535+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:37.535833+0000) 2021-08-03T13:08:37.876 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:37.871+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:37.872275+0000) 2021-08-03T13:08:38.030 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:38.025+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:38.026523+0000) 2021-08-03T13:08:38.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:38.693+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:38.694125+0000) 2021-08-03T13:08:38.877 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:38.872+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:38.872903+0000) 2021-08-03T13:08:39.031 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:39.026+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:39.027070+0000) 2021-08-03T13:08:39.461 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:39.455+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:39.456059+0000) 2021-08-03T13:08:39.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:39.693+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:39.694263+0000) 2021-08-03T13:08:39.878 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:39.872+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:39.873512+0000) 2021-08-03T13:08:39.905 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:39.900+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:39.900834+0000) 2021-08-03T13:08:39.906 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:39.900+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:39.901014+0000) 2021-08-03T13:08:40.032 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:40.026+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:40.027620+0000) 2021-08-03T13:08:40.155 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:40.150+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:40.150994+0000) 2021-08-03T13:08:40.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:40.195+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:40.195930+0000) 2021-08-03T13:08:40.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:40.693+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:40.694420+0000) 2021-08-03T13:08:40.878 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:40.873+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:40.874078+0000) 2021-08-03T13:08:41.033 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:41.028+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:41.029191+0000) 2021-08-03T13:08:41.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:41.391+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:41.392317+0000) 2021-08-03T13:08:41.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:41.693+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:41.694556+0000) 2021-08-03T13:08:41.744 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:41.738+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:41.739207+0000) 2021-08-03T13:08:41.879 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:41.873+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:41.874622+0000) 2021-08-03T13:08:41.899 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:41.879+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4242 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:41.901 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:08:41.895+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:41.895768+0000) 2021-08-03T13:08:41.992 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:41.971+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9893 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:42.034 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:42.028+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:42.029768+0000) 2021-08-03T13:08:42.153 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:42.148+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:42.149562+0000) 2021-08-03T13:08:42.419 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:42.147+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9592 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:42.698 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:42.693+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:42.694682+0000) 2021-08-03T13:08:42.880 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:42.874+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:42.875366+0000) 2021-08-03T13:08:42.930 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:42.924+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:42.925337+0000) 2021-08-03T13:08:43.035 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:43.030+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:43.030937+0000) 2021-08-03T13:08:43.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:43.694+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:43.694847+0000) 2021-08-03T13:08:43.880 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:43.875+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:43.875958+0000) 2021-08-03T13:08:44.036 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:44.030+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:44.031581+0000) 2021-08-03T13:08:44.331 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:44.324+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:44.325397+0000) 2021-08-03T13:08:44.530 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:44.524+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:44.524897+0000) 2021-08-03T13:08:44.599 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:44.594+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:44.595162+0000) 2021-08-03T13:08:44.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:44.694+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:44.694975+0000) 2021-08-03T13:08:45.037 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:45.032+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:45.032859+0000) 2021-08-03T13:08:45.129 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:45.124+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:45.125685+0000) 2021-08-03T13:08:45.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:45.694+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:45.695141+0000) 2021-08-03T13:08:46.038 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:46.032+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:46.033596+0000) 2021-08-03T13:08:46.118 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:46.113+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:46.114495+0000) 2021-08-03T13:08:46.224 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:46.217+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:46.218173+0000) 2021-08-03T13:08:46.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:46.694+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:46.695288+0000) 2021-08-03T13:08:46.750 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:46.744+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:46.745193+0000) 2021-08-03T13:08:47.039 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:47.033+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:47.034374+0000) 2021-08-03T13:08:47.279 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:47.205+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9897 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:47.544 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:47.538+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:47.539131+0000) 2021-08-03T13:08:47.699 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:47.694+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:47.695439+0000) 2021-08-03T13:08:47.719 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:47.712+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:47.713096+0000) 2021-08-03T13:08:48.039 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:48.034+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:48.034987+0000) 2021-08-03T13:08:48.424 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:47.387+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4242 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:48.670 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:48.663+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:48.664604+0000) 2021-08-03T13:08:49.047 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:48.791+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9594 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:49.119 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:49.112+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:49.113459+0000) 2021-08-03T13:08:49.422 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:49.417+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:49.418143+0000) 2021-08-03T13:08:49.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:49.524+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:49.525398+0000) 2021-08-03T13:08:49.765 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:49.760+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:49.761356+0000) 2021-08-03T13:08:49.797 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:49.791+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:49.791805+0000) 2021-08-03T13:08:49.896 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:49.890+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:49.891186+0000) 2021-08-03T13:08:50.055 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:50.049+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:50.050144+0000) 2021-08-03T13:08:50.395 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:50.390+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:50.391168+0000) 2021-08-03T13:08:50.424 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:50.419+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:50.420516+0000) 2021-08-03T13:08:50.521 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:50.515+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:50.515798+0000) 2021-08-03T13:08:50.896 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:50.891+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:50.891979+0000) 2021-08-03T13:08:51.055 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:51.049+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:51.050670+0000) 2021-08-03T13:08:51.424 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:51.419+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:51.420634+0000) 2021-08-03T13:08:51.521 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:51.515+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:51.516532+0000) 2021-08-03T13:08:51.561 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:51.554+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:51.555229+0000) 2021-08-03T13:08:51.897 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:51.891+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:51.892587+0000) 2021-08-03T13:08:52.056 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:52.050+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:52.051221+0000) 2021-08-03T13:08:52.424 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:52.419+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:52.420756+0000) 2021-08-03T13:08:52.614 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:08:52.607+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:52.608216+0000) 2021-08-03T13:08:52.898 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:52.892+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:52.893265+0000) 2021-08-03T13:08:53.056 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:53.051+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:53.051776+0000) 2021-08-03T13:08:53.474 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:52.624+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9899 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:53.668 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:53.663+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:53.664025+0000) 2021-08-03T13:08:53.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:53.700+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:53.701777+0000) 2021-08-03T13:08:53.723 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:08:53.719+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:53.720172+0000) 2021-08-03T13:08:53.899 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:53.893+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:53.893871+0000) 2021-08-03T13:08:54.057 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:54.051+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:54.052339+0000) 2021-08-03T13:08:54.554 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:08:54.547+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:54.548209+0000) 2021-08-03T13:08:54.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:54.701+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:54.701909+0000) 2021-08-03T13:08:54.899 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:54.893+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:54.894640+0000) 2021-08-03T13:08:55.058 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:08:55.052+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:55.052906+0000) 2021-08-03T13:08:55.110 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:08:55.070+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9620 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:08:55.226 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:08:54.743+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4242 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:08:55.587 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:08:55.580+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:55.581690+0000) 2021-08-03T13:08:56.910 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:56.905+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:56.906246+0000) 2021-08-03T13:08:57.588 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:57.583+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:57.584718+0000) 2021-08-03T13:08:57.647 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:08:57.639+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:57.641493+0000) 2021-08-03T13:08:58.044 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:58.039+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:58.040520+0000) 2021-08-03T13:08:58.046 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:08:57.966+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9918 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:08:58.211 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:58.206+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:58.207415+0000) 2021-08-03T13:08:58.214 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:08:58.207+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:58.209633+0000) 2021-08-03T13:08:58.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:58.584+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:58.584856+0000) 2021-08-03T13:08:59.473 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:08:59.466+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:59.467519+0000) 2021-08-03T13:08:59.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:08:59.584+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:08:59.584965+0000) 2021-08-03T13:09:00.385 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:00.378+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:00.379701+0000) 2021-08-03T13:09:00.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:00.584+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:00.585095+0000) 2021-08-03T13:09:00.671 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:00.665+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:00.666268+0000) 2021-08-03T13:09:00.984 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:00.978+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:00.980835+0000) 2021-08-03T13:09:01.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:01.584+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:01.585237+0000) 2021-08-03T13:09:01.701 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:01.692+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9632 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:02.374 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:01.803+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4246 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:02.749 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:02.743+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:02.743784+0000) 2021-08-03T13:09:03.724 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:03.684+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9919 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:03.749 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:03.743+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:03.744599+0000) 2021-08-03T13:09:04.750 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:04.744+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:04.745352+0000) 2021-08-03T13:09:04.755 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:04.750+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:04.751478+0000) 2021-08-03T13:09:04.886 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:04.881+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:04.881959+0000) 2021-08-03T13:09:05.646 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:05.639+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:05.640778+0000) 2021-08-03T13:09:05.831 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:05.826+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:05.827372+0000) 2021-08-03T13:09:05.887 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:05.881+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:05.882673+0000) 2021-08-03T13:09:06.163 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:06.158+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:06.159286+0000) 2021-08-03T13:09:06.200 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:06.195+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:06.195894+0000) 2021-08-03T13:09:06.675 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:06.669+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:06.669995+0000) 2021-08-03T13:09:06.831 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:06.826+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:06.827522+0000) 2021-08-03T13:09:06.887 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:06.882+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:06.883214+0000) 2021-08-03T13:09:07.202 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:07.197+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:07.197548+0000) 2021-08-03T13:09:07.675 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:07.670+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:07.670748+0000) 2021-08-03T13:09:07.678 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:07.673+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:07.674340+0000) 2021-08-03T13:09:07.831 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:07.826+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:07.827644+0000) 2021-08-03T13:09:07.888 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:07.882+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:07.883793+0000) 2021-08-03T13:09:08.203 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:08.198+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:08.198952+0000) 2021-08-03T13:09:08.676 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:08.670+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:08.671570+0000) 2021-08-03T13:09:08.681 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:08.676+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:08.677765+0000) 2021-08-03T13:09:08.831 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:08.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:08.827799+0000) 2021-08-03T13:09:08.889 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:08.883+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:08.884359+0000) 2021-08-03T13:09:09.043 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:09.038+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.038989+0000) 2021-08-03T13:09:09.204 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:09.199+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.200136+0000) 2021-08-03T13:09:09.237 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:09.231+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.232321+0000) 2021-08-03T13:09:09.676 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:09.671+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.672133+0000) 2021-08-03T13:09:09.685 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:09.680+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.681226+0000) 2021-08-03T13:09:09.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:09.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.827956+0000) 2021-08-03T13:09:09.864 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:09.857+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.857972+0000) 2021-08-03T13:09:09.889 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:09.884+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:09.884933+0000) 2021-08-03T13:09:10.006 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:09.999+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9639 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:10.044 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:10.038+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:10.039749+0000) 2021-08-03T13:09:10.074 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:10.040+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4246 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:10.238 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:10.232+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:10.233053+0000) 2021-08-03T13:09:10.294 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:10.288+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:10.288878+0000) 2021-08-03T13:09:10.677 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:10.671+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:10.672765+0000) 2021-08-03T13:09:10.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:10.683+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:10.684558+0000) 2021-08-03T13:09:10.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:10.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:10.828078+0000) 2021-08-03T13:09:10.890 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:10.884+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:10.885499+0000) 2021-08-03T13:09:11.001 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:10.995+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9930 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:11.044 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:11.039+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.040334+0000) 2021-08-03T13:09:11.051 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:11.045+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.046011+0000) 2021-08-03T13:09:11.150 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:11.143+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.144146+0000) 2021-08-03T13:09:11.238 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:11.232+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.233638+0000) 2021-08-03T13:09:11.478 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:11.473+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.474545+0000) 2021-08-03T13:09:11.523 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:11.517+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.517933+0000) 2021-08-03T13:09:11.678 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:11.672+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.673361+0000) 2021-08-03T13:09:11.688 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:11.683+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.684715+0000) 2021-08-03T13:09:11.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:11.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.828196+0000) 2021-08-03T13:09:11.890 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:11.885+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:11.886071+0000) 2021-08-03T13:09:12.045 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:12.040+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.040885+0000) 2021-08-03T13:09:12.239 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:12.233+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.234274+0000) 2021-08-03T13:09:12.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:12.391+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.392689+0000) 2021-08-03T13:09:12.414 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:12.409+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.410335+0000) 2021-08-03T13:09:12.679 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:12.673+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.673959+0000) 2021-08-03T13:09:12.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:12.684+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.684979+0000) 2021-08-03T13:09:12.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:12.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.828350+0000) 2021-08-03T13:09:12.891 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:12.886+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:12.886819+0000) 2021-08-03T13:09:13.239 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:13.234+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:13.234899+0000) 2021-08-03T13:09:13.423 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:13.416+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:13.417695+0000) 2021-08-03T13:09:13.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:13.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:13.828495+0000) 2021-08-03T13:09:14.240 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:14.234+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:14.235481+0000) 2021-08-03T13:09:14.471 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:14.465+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:14.465816+0000) 2021-08-03T13:09:14.810 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:14.805+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:14.805892+0000) 2021-08-03T13:09:14.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:14.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:14.828615+0000) 2021-08-03T13:09:15.241 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:15.235+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:15.236453+0000) 2021-08-03T13:09:15.485 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:15.477+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:15.478222+0000) 2021-08-03T13:09:15.550 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:15.545+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:15.546390+0000) 2021-08-03T13:09:15.645 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:15.639+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:15.640052+0000) 2021-08-03T13:09:15.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:15.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:15.828732+0000) 2021-08-03T13:09:16.166 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:16.161+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:16.162663+0000) 2021-08-03T13:09:16.242 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:16.236+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:16.237439+0000) 2021-08-03T13:09:16.433 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:16.406+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9645 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:16.833 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:16.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:16.828889+0000) 2021-08-03T13:09:16.898 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:16.893+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:16.894669+0000) 2021-08-03T13:09:17.031 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:16.909+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9947 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:17.243 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:17.236+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:17.238116+0000) 2021-08-03T13:09:17.485 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:17.349+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4248 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:17.644 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:17.638+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:17.638872+0000) 2021-08-03T13:09:17.728 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:17.722+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:17.723117+0000) 2021-08-03T13:09:17.833 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:17.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:17.829046+0000) 2021-08-03T13:09:18.244 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:18.237+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:18.238737+0000) 2021-08-03T13:09:18.378 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:18.371+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:18.372684+0000) 2021-08-03T13:09:18.524 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:18.518+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:18.519485+0000) 2021-08-03T13:09:18.833 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:18.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:18.829203+0000) 2021-08-03T13:09:19.245 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:19.237+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:19.239603+0000) 2021-08-03T13:09:19.833 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:19.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:19.829354+0000) 2021-08-03T13:09:20.016 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:20.008+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:20.010081+0000) 2021-08-03T13:09:20.128 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:20.122+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:20.124561+0000) 2021-08-03T13:09:20.245 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:20.238+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:20.240638+0000) 2021-08-03T13:09:20.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:20.435+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:20.436923+0000) 2021-08-03T13:09:20.833 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:20.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:20.829528+0000) 2021-08-03T13:09:21.246 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:21.239+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:21.241214+0000) 2021-08-03T13:09:21.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:21.362+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:21.363840+0000) 2021-08-03T13:09:21.598 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:21.590+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:21.592502+0000) 2021-08-03T13:09:21.833 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:21.827+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:21.829694+0000) 2021-08-03T13:09:22.246 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:22.240+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:22.241846+0000) 2021-08-03T13:09:22.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:22.362+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:22.363950+0000) 2021-08-03T13:09:22.834 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:22.828+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:22.829865+0000) 2021-08-03T13:09:23.247 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:23.240+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:23.242475+0000) 2021-08-03T13:09:23.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:23.362+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:23.364087+0000) 2021-08-03T13:09:23.425 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:23.420+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:23.421199+0000) 2021-08-03T13:09:23.476 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:23.469+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:23.470852+0000) 2021-08-03T13:09:23.612 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:23.519+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9675 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:23.778 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:23.735+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9960 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:23.781 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:23.775+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:23.776118+0000) 2021-08-03T13:09:23.802 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:23.795+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:23.796084+0000) 2021-08-03T13:09:23.834 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:23.828+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:23.830002+0000) 2021-08-03T13:09:24.115 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:24.109+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:24.110827+0000) 2021-08-03T13:09:24.247 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:24.241+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:24.243114+0000) 2021-08-03T13:09:24.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:24.362+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:24.364211+0000) 2021-08-03T13:09:24.834 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:24.828+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:24.830179+0000) 2021-08-03T13:09:25.248 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:25.242+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:25.243755+0000) 2021-08-03T13:09:25.366 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:25.360+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:25.360988+0000) 2021-08-03T13:09:25.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:25.362+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:25.364334+0000) 2021-08-03T13:09:25.397 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:24.307+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4248 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:25.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:25.750+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:25.750934+0000) 2021-08-03T13:09:25.834 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:25.829+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:25.830358+0000) 2021-08-03T13:09:26.249 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:26.243+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:26.244365+0000) 2021-08-03T13:09:26.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:26.363+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:26.364450+0000) 2021-08-03T13:09:26.756 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:26.751+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:26.751909+0000) 2021-08-03T13:09:27.250 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:27.244+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:27.245470+0000) 2021-08-03T13:09:27.358 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:27.353+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:27.353928+0000) 2021-08-03T13:09:27.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:27.363+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:27.364573+0000) 2021-08-03T13:09:27.423 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:27.418+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:27.419256+0000) 2021-08-03T13:09:27.757 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:27.751+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:27.752506+0000) 2021-08-03T13:09:27.937 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:27.931+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:27.932068+0000) 2021-08-03T13:09:28.251 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:28.245+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:28.246056+0000) 2021-08-03T13:09:28.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:28.363+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:28.364705+0000) 2021-08-03T13:09:28.730 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:28.725+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:28.726205+0000) 2021-08-03T13:09:28.781 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:28.776+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:28.777169+0000) 2021-08-03T13:09:29.255 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:29.245+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:29.246673+0000) 2021-08-03T13:09:29.368 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:29.364+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:29.364859+0000) 2021-08-03T13:09:29.783 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:29.777+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:29.778144+0000) 2021-08-03T13:09:29.793 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:29.787+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:29.787759+0000) 2021-08-03T13:09:30.334 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:30.329+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:30.330637+0000) 2021-08-03T13:09:30.335 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:30.329+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9964 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:30.345 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:30.255+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9693 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:30.639 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:30.632+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:30.633065+0000) 2021-08-03T13:09:31.505 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:31.498+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:31.499351+0000) 2021-08-03T13:09:32.288 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:32.229+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4248 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:32.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:32.407+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:32.408226+0000) 2021-08-03T13:09:32.975 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:32.969+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:32.970156+0000) 2021-08-03T13:09:33.881 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:33.874+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:33.875249+0000) 2021-08-03T13:09:33.894 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:33.889+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:33.890264+0000) 2021-08-03T13:09:34.832 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:34.827+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:34.828203+0000) 2021-08-03T13:09:34.896 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:34.891+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:34.891834+0000) 2021-08-03T13:09:35.182 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:35.176+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:35.176864+0000) 2021-08-03T13:09:35.190 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:35.185+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:35.186228+0000) 2021-08-03T13:09:35.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:35.770+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:35.771040+0000) 2021-08-03T13:09:35.897 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:35.891+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:35.892440+0000) 2021-08-03T13:09:35.921 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:35.806+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9695 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:36.182 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:36.176+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:36.177487+0000) 2021-08-03T13:09:36.889 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:36.884+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:36.884998+0000) 2021-08-03T13:09:36.897 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:36.892+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:36.893011+0000) 2021-08-03T13:09:36.914 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:36.716+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9973 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:36.935 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:36.928+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:36.929509+0000) 2021-08-03T13:09:37.183 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:37.177+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:37.178109+0000) 2021-08-03T13:09:37.379 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:37.373+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:37.373793+0000) 2021-08-03T13:09:37.898 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:37.892+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:37.893598+0000) 2021-08-03T13:09:38.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:38.080+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:38.081059+0000) 2021-08-03T13:09:38.183 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:38.177+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:38.178711+0000) 2021-08-03T13:09:38.899 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:38.893+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:38.894210+0000) 2021-08-03T13:09:39.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:39.080+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:39.081183+0000) 2021-08-03T13:09:39.095 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:39.088+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:39.089584+0000) 2021-08-03T13:09:39.184 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:39.178+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:39.179353+0000) 2021-08-03T13:09:39.215 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:39.208+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:39.208907+0000) 2021-08-03T13:09:39.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:39.253+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:39.254059+0000) 2021-08-03T13:09:39.866 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:39.861+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:39.862389+0000) 2021-08-03T13:09:39.900 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:39.894+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:39.895127+0000) 2021-08-03T13:09:40.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:40.080+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.081302+0000) 2021-08-03T13:09:40.120 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:40.115+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.116643+0000) 2021-08-03T13:09:40.185 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:40.179+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.179900+0000) 2021-08-03T13:09:40.211 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:40.205+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.206397+0000) 2021-08-03T13:09:40.212 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:40.206+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.206857+0000) 2021-08-03T13:09:40.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:40.253+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.254247+0000) 2021-08-03T13:09:40.636 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:40.531+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4248 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:40.868 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:40.862+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.862912+0000) 2021-08-03T13:09:40.966 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:40.960+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:40.961593+0000) 2021-08-03T13:09:41.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:41.080+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:41.081471+0000) 2021-08-03T13:09:41.185 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:41.179+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:41.180627+0000) 2021-08-03T13:09:41.212 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:41.206+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:41.207719+0000) 2021-08-03T13:09:41.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:41.253+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:41.254348+0000) 2021-08-03T13:09:41.868 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:41.862+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:41.863496+0000) 2021-08-03T13:09:42.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:42.080+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:42.081589+0000) 2021-08-03T13:09:42.186 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:42.180+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:42.181214+0000) 2021-08-03T13:09:42.213 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:42.207+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:42.208327+0000) 2021-08-03T13:09:42.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:42.253+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:42.254488+0000) 2021-08-03T13:09:42.396 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:42.392+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:42.392947+0000) 2021-08-03T13:09:42.868 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:42.863+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:42.864056+0000) 2021-08-03T13:09:43.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:43.080+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:43.081710+0000) 2021-08-03T13:09:43.186 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:43.181+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:43.181817+0000) 2021-08-03T13:09:43.214 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:43.208+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:43.209156+0000) 2021-08-03T13:09:43.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:43.253+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:43.254630+0000) 2021-08-03T13:09:43.294 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:43.287+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9976 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:43.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:43.392+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:43.393092+0000) 2021-08-03T13:09:43.655 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:43.596+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9703 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:43.685 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:43.679+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:43.680398+0000) 2021-08-03T13:09:44.085 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:44.081+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:44.081867+0000) 2021-08-03T13:09:44.187 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:44.181+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:44.182360+0000) 2021-08-03T13:09:44.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:44.253+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:44.254781+0000) 2021-08-03T13:09:44.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:44.392+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:44.393190+0000) 2021-08-03T13:09:44.686 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:44.680+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:44.681432+0000) 2021-08-03T13:09:45.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:45.081+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:45.082022+0000) 2021-08-03T13:09:45.163 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:45.156+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:45.157314+0000) 2021-08-03T13:09:45.187 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:45.182+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:45.182946+0000) 2021-08-03T13:09:45.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:45.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:45.254916+0000) 2021-08-03T13:09:45.481 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:45.476+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:45.477534+0000) 2021-08-03T13:09:45.584 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:45.577+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:45.578654+0000) 2021-08-03T13:09:45.947 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:45.940+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:45.941690+0000) 2021-08-03T13:09:46.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:46.081+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:46.082174+0000) 2021-08-03T13:09:46.188 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:46.182+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:46.183542+0000) 2021-08-03T13:09:46.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:46.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:46.255023+0000) 2021-08-03T13:09:46.785 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:09:46.778+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:46.779494+0000) 2021-08-03T13:09:46.799 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:46.795+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:46.796021+0000) 2021-08-03T13:09:47.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:47.081+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:47.082316+0000) 2021-08-03T13:09:47.189 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:47.183+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:47.184292+0000) 2021-08-03T13:09:47.248 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:47.243+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:47.244106+0000) 2021-08-03T13:09:47.254 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:47.247+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:47.248247+0000) 2021-08-03T13:09:47.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:47.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:47.255129+0000) 2021-08-03T13:09:48.041 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:48.034+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:48.035057+0000) 2021-08-03T13:09:48.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:48.081+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:48.082462+0000) 2021-08-03T13:09:48.189 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:48.184+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:48.185008+0000) 2021-08-03T13:09:48.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:48.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:48.255252+0000) 2021-08-03T13:09:48.445 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:48.357+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 9994 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:49.007 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:49.002+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:49.003056+0000) 2021-08-03T13:09:49.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:49.081+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:49.082631+0000) 2021-08-03T13:09:49.190 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:49.184+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:49.185721+0000) 2021-08-03T13:09:49.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:49.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:49.255382+0000) 2021-08-03T13:09:49.511 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:49.505+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:49.506380+0000) 2021-08-03T13:09:49.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:49.526+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:49.526853+0000) 2021-08-03T13:09:49.787 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:49.753+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9709 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:49.873 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:09:49.866+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:49.867109+0000) 2021-08-03T13:09:50.086 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:50.081+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:50.082791+0000) 2021-08-03T13:09:50.098 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:50.092+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4250 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:50.191 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:50.185+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:50.186294+0000) 2021-08-03T13:09:50.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:50.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:50.255536+0000) 2021-08-03T13:09:50.364 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:50.357+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:50.358647+0000) 2021-08-03T13:09:50.384 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:50.378+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:50.378826+0000) 2021-08-03T13:09:50.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:50.406+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:50.407634+0000) 2021-08-03T13:09:50.789 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:50.783+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:50.783819+0000) 2021-08-03T13:09:51.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:51.082+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:51.082932+0000) 2021-08-03T13:09:51.141 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:09:51.135+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:51.136368+0000) 2021-08-03T13:09:51.191 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:51.186+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:51.186985+0000) 2021-08-03T13:09:51.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:51.254+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:51.255662+0000) 2021-08-03T13:09:51.789 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:51.783+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:51.784529+0000) 2021-08-03T13:09:52.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:52.082+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:52.083082+0000) 2021-08-03T13:09:52.192 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:52.186+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:52.187572+0000) 2021-08-03T13:09:52.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:52.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:52.255810+0000) 2021-08-03T13:09:52.790 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:52.784+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:52.785287+0000) 2021-08-03T13:09:53.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:53.082+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:53.083239+0000) 2021-08-03T13:09:53.193 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:53.187+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:53.188508+0000) 2021-08-03T13:09:53.259 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:53.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:53.255942+0000) 2021-08-03T13:09:53.910 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:53.872+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10001 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:54.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:54.082+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:54.083396+0000) 2021-08-03T13:09:54.194 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:54.188+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:54.189071+0000) 2021-08-03T13:09:54.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:54.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:54.256090+0000) 2021-08-03T13:09:54.425 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:54.420+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:54.421770+0000) 2021-08-03T13:09:54.861 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:54.855+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:54.856625+0000) 2021-08-03T13:09:55.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:55.082+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:55.083541+0000) 2021-08-03T13:09:55.194 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:55.188+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:55.189634+0000) 2021-08-03T13:09:55.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:55.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:55.256237+0000) 2021-08-03T13:09:55.425 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:55.421+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:55.421915+0000) 2021-08-03T13:09:55.859 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:09:55.852+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:55.853137+0000) 2021-08-03T13:09:56.063 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:56.058+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:56.059060+0000) 2021-08-03T13:09:56.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:56.082+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:56.083690+0000) 2021-08-03T13:09:56.112 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:09:56.106+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:56.107024+0000) 2021-08-03T13:09:56.195 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:56.189+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:56.190223+0000) 2021-08-03T13:09:56.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:56.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:56.256368+0000) 2021-08-03T13:09:56.425 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:56.421+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:56.422042+0000) 2021-08-03T13:09:57.039 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:09:57.002+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9710 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:09:57.064 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:57.059+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:57.059918+0000) 2021-08-03T13:09:57.087 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:57.083+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:57.083854+0000) 2021-08-03T13:09:57.195 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:57.190+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:57.190802+0000) 2021-08-03T13:09:57.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:57.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:57.256517+0000) 2021-08-03T13:09:57.790 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:57.785+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:57.786425+0000) 2021-08-03T13:09:58.065 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:58.059+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:58.060499+0000) 2021-08-03T13:09:58.067 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:09:57.890+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4250 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:09:58.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:58.083+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:58.084000+0000) 2021-08-03T13:09:58.196 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:58.190+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:58.191419+0000) 2021-08-03T13:09:58.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:58.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:58.256658+0000) 2021-08-03T13:09:58.331 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:09:58.326+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:58.327729+0000) 2021-08-03T13:09:59.008 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:09:58.934+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10013 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:09:59.066 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:09:59.060+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:59.061288+0000) 2021-08-03T13:09:59.069 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:09:59.062+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:59.063683+0000) 2021-08-03T13:09:59.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:59.083+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:59.084134+0000) 2021-08-03T13:09:59.196 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:09:59.191+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:59.191986+0000) 2021-08-03T13:09:59.260 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:09:59.255+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:09:59.256768+0000) 2021-08-03T13:10:00.066 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:00.061+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:00.062137+0000) 2021-08-03T13:10:00.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:00.083+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:00.084290+0000) 2021-08-03T13:10:00.198 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:00.191+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:00.192554+0000) 2021-08-03T13:10:00.261 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:00.256+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:00.256910+0000) 2021-08-03T13:10:00.904 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:00.898+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:00.899662+0000) 2021-08-03T13:10:01.067 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:01.062+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:01.062708+0000) 2021-08-03T13:10:01.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:01.083+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:01.084411+0000) 2021-08-03T13:10:01.261 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:01.256+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:01.257018+0000) 2021-08-03T13:10:01.906 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:01.900+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:01.901282+0000) 2021-08-03T13:10:02.068 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:02.062+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:02.063487+0000) 2021-08-03T13:10:02.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:02.083+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:02.084542+0000) 2021-08-03T13:10:02.261 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:02.256+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:02.257166+0000) 2021-08-03T13:10:02.534 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:02.527+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:02.528326+0000) 2021-08-03T13:10:02.906 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:02.901+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:02.902056+0000) 2021-08-03T13:10:03.054 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:03.048+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:03.049729+0000) 2021-08-03T13:10:03.068 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:03.063+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:03.064068+0000) 2021-08-03T13:10:03.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:03.083+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:03.084688+0000) 2021-08-03T13:10:03.168 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:03.162+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:03.163148+0000) 2021-08-03T13:10:03.261 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:03.256+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:03.257315+0000) 2021-08-03T13:10:03.907 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:03.902+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:03.902864+0000) 2021-08-03T13:10:04.013 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:03.992+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10015 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:04.056 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:04.050+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:04.051759+0000) 2021-08-03T13:10:04.069 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:04.064+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:04.065012+0000) 2021-08-03T13:10:04.088 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:04.084+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:04.084854+0000) 2021-08-03T13:10:04.310 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:04.305+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:04.305947+0000) 2021-08-03T13:10:04.415 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:04.408+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:04.409236+0000) 2021-08-03T13:10:04.521 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:04.500+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9715 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:04.701 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:04.695+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:04.695962+0000) 2021-08-03T13:10:05.123 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:05.073+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4250 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:05.701 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:05.696+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:05.696909+0000) 2021-08-03T13:10:06.226 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:06.219+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:06.220225+0000) 2021-08-03T13:10:06.242 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:06.236+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:06.238606+0000) 2021-08-03T13:10:06.702 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:06.695+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:06.697513+0000) 2021-08-03T13:10:07.116 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:07.110+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:07.112689+0000) 2021-08-03T13:10:07.703 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:07.697+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:07.698847+0000) 2021-08-03T13:10:07.991 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:07.984+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:07.985387+0000) 2021-08-03T13:10:08.364 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:08.358+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:08.360205+0000) 2021-08-03T13:10:08.704 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:08.697+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:08.699453+0000) 2021-08-03T13:10:08.764 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:08.755+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:08.757136+0000) 2021-08-03T13:10:09.032 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:09.025+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:09.027690+0000) 2021-08-03T13:10:09.378 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:09.269+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10015 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:09.430 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:09.424+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:09.426660+0000) 2021-08-03T13:10:09.705 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:09.698+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:09.700234+0000) 2021-08-03T13:10:10.226 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:10.141+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9728 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:10.694 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:10.174+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4250 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:11.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:11.195+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:11.196869+0000) 2021-08-03T13:10:11.966 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:11.958+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:11.960544+0000) 2021-08-03T13:10:12.219 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:12.211+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:12.213685+0000) 2021-08-03T13:10:13.091 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:13.085+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:13.087104+0000) 2021-08-03T13:10:13.598 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:13.590+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:13.592297+0000) 2021-08-03T13:10:13.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:13.684+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:13.685806+0000) 2021-08-03T13:10:13.793 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:13.786+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:13.788505+0000) 2021-08-03T13:10:14.221 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:14.214+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:14.216503+0000) 2021-08-03T13:10:14.234 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:14.226+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:14.228657+0000) 2021-08-03T13:10:14.417 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:14.411+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:14.413737+0000) 2021-08-03T13:10:14.693 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:14.687+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:14.689190+0000) 2021-08-03T13:10:14.794 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:14.788+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:14.789408+0000) 2021-08-03T13:10:15.222 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:15.215+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:15.217238+0000) 2021-08-03T13:10:15.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:15.392+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:15.393624+0000) 2021-08-03T13:10:15.414 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:15.408+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:15.409534+0000) 2021-08-03T13:10:15.694 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:15.683+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:15.685456+0000) 2021-08-03T13:10:15.695 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:15.690+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:15.691792+0000) 2021-08-03T13:10:15.794 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:15.789+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:15.789921+0000) 2021-08-03T13:10:15.926 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:15.800+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10017 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:15.942 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:15.844+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9733 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:16.013 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:16.008+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:16.009672+0000) 2021-08-03T13:10:16.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:16.392+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:16.393749+0000) 2021-08-03T13:10:16.512 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:16.504+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:16.506200+0000) 2021-08-03T13:10:16.691 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:16.684+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:16.686585+0000) 2021-08-03T13:10:17.241 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:17.236+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:17.237825+0000) 2021-08-03T13:10:17.254 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:17.246+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4250 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:17.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:17.393+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:17.393897+0000) 2021-08-03T13:10:17.458 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:17.452+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:17.453481+0000) 2021-08-03T13:10:17.692 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:17.686+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:17.687022+0000) 2021-08-03T13:10:17.884 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:17.880+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:17.880822+0000) 2021-08-03T13:10:18.001 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:17.995+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:17.996059+0000) 2021-08-03T13:10:18.098 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:18.091+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:18.092297+0000) 2021-08-03T13:10:18.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:18.393+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:18.394027+0000) 2021-08-03T13:10:18.415 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:18.407+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:18.408450+0000) 2021-08-03T13:10:18.458 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:18.453+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:18.454172+0000) 2021-08-03T13:10:18.692 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:18.687+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:18.687834+0000) 2021-08-03T13:10:19.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:19.393+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:19.394172+0000) 2021-08-03T13:10:19.459 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:19.454+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:19.454775+0000) 2021-08-03T13:10:19.693 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:19.687+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:19.688435+0000) 2021-08-03T13:10:19.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:19.699+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:19.700031+0000) 2021-08-03T13:10:20.275 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:20.269+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:20.269758+0000) 2021-08-03T13:10:20.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:20.393+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:20.394287+0000) 2021-08-03T13:10:20.460 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:20.454+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:20.455411+0000) 2021-08-03T13:10:20.693 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:20.688+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:20.689479+0000) 2021-08-03T13:10:20.926 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:20.919+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:20.920484+0000) 2021-08-03T13:10:21.137 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:21.132+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:21.132904+0000) 2021-08-03T13:10:21.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:21.393+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:21.394421+0000) 2021-08-03T13:10:21.460 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:21.455+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:21.455989+0000) 2021-08-03T13:10:21.695 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:21.689+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:21.690079+0000) 2021-08-03T13:10:21.713 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:21.708+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:21.709005+0000) 2021-08-03T13:10:21.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:21.959+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:21.960418+0000) 2021-08-03T13:10:22.137 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:22.132+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:22.133053+0000) 2021-08-03T13:10:22.253 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:22.165+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10043 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:22.361 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:22.356+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:22.357481+0000) 2021-08-03T13:10:22.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:22.393+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:22.394554+0000) 2021-08-03T13:10:22.696 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:22.690+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:22.690970+0000) 2021-08-03T13:10:22.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:22.959+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:22.960569+0000) 2021-08-03T13:10:23.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:23.393+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:23.394663+0000) 2021-08-03T13:10:23.518 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:23.232+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4250 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:23.696 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:23.690+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:23.691594+0000) 2021-08-03T13:10:23.950 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:23.895+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9748 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:23.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:23.959+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:23.960702+0000) 2021-08-03T13:10:23.996 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:23.992+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:23.992838+0000) 2021-08-03T13:10:24.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:24.394+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.394819+0000) 2021-08-03T13:10:24.416 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:24.411+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.412331+0000) 2021-08-03T13:10:24.689 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:24.682+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.683675+0000) 2021-08-03T13:10:24.693 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:24.687+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.688392+0000) 2021-08-03T13:10:24.707 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:24.700+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.701105+0000) 2021-08-03T13:10:24.891 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:24.885+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.885943+0000) 2021-08-03T13:10:24.911 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:24.906+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.907279+0000) 2021-08-03T13:10:24.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:24.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:24.960861+0000) 2021-08-03T13:10:25.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:25.394+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:25.394971+0000) 2021-08-03T13:10:25.567 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:25.561+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:25.562022+0000) 2021-08-03T13:10:25.570 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:25.563+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:25.564074+0000) 2021-08-03T13:10:25.572 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:25.567+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:25.568466+0000) 2021-08-03T13:10:25.912 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:25.907+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:25.908009+0000) 2021-08-03T13:10:25.939 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:25.932+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:25.933289+0000) 2021-08-03T13:10:25.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:25.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:25.961004+0000) 2021-08-03T13:10:26.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:26.394+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:26.395137+0000) 2021-08-03T13:10:26.913 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:26.907+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:26.908584+0000) 2021-08-03T13:10:26.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:26.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:26.961122+0000) 2021-08-03T13:10:27.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:27.394+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:27.395251+0000) 2021-08-03T13:10:27.426 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:27.421+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:27.422515+0000) 2021-08-03T13:10:27.914 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:27.908+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:27.909444+0000) 2021-08-03T13:10:27.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:27.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:27.961242+0000) 2021-08-03T13:10:28.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:28.394+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:28.395366+0000) 2021-08-03T13:10:28.422 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:28.316+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10043 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:28.915 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:28.909+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:28.910111+0000) 2021-08-03T13:10:28.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:28.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:28.961404+0000) 2021-08-03T13:10:28.977 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:28.970+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:28.971177+0000) 2021-08-03T13:10:29.064 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:29.059+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.060821+0000) 2021-08-03T13:10:29.214 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:29.209+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.210031+0000) 2021-08-03T13:10:29.399 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:29.394+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.395501+0000) 2021-08-03T13:10:29.451 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:29.445+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.446063+0000) 2021-08-03T13:10:29.814 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:29.807+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.808487+0000) 2021-08-03T13:10:29.915 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:29.910+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.910920+0000) 2021-08-03T13:10:29.939 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:29.870+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9762 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:29.955 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:29.948+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.949233+0000) 2021-08-03T13:10:29.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:29.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:29.961536+0000) 2021-08-03T13:10:30.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:30.394+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:30.395660+0000) 2021-08-03T13:10:30.769 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:30.724+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4251 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:30.916 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:30.911+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:30.912230+0000) 2021-08-03T13:10:30.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:30.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:30.961679+0000) 2021-08-03T13:10:31.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:31.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:31.395791+0000) 2021-08-03T13:10:31.471 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:31.463+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:31.464478+0000) 2021-08-03T13:10:31.816 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:31.809+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:31.810557+0000) 2021-08-03T13:10:31.918 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:31.912+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:31.913384+0000) 2021-08-03T13:10:31.965 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:31.960+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:31.961803+0000) 2021-08-03T13:10:32.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:32.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:32.395915+0000) 2021-08-03T13:10:32.653 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:32.648+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:32.649249+0000) 2021-08-03T13:10:32.831 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:32.824+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:32.824810+0000) 2021-08-03T13:10:32.919 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:32.913+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:32.914525+0000) 2021-08-03T13:10:32.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:32.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:32.961959+0000) 2021-08-03T13:10:33.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:33.257+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:33.258496+0000) 2021-08-03T13:10:33.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:33.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:33.396048+0000) 2021-08-03T13:10:33.920 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:33.914+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:33.915482+0000) 2021-08-03T13:10:33.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:33.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:33.962094+0000) 2021-08-03T13:10:34.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:34.257+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:34.258657+0000) 2021-08-03T13:10:34.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:34.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:34.396161+0000) 2021-08-03T13:10:34.921 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:34.915+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:34.916460+0000) 2021-08-03T13:10:34.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:34.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:34.962256+0000) 2021-08-03T13:10:35.060 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:35.054+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:35.055243+0000) 2021-08-03T13:10:35.077 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:35.071+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:35.072347+0000) 2021-08-03T13:10:35.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:35.257+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:35.258783+0000) 2021-08-03T13:10:35.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:35.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:35.396283+0000) 2021-08-03T13:10:35.709 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:35.702+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10043 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:35.922 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:35.916+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:35.917525+0000) 2021-08-03T13:10:35.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:35.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:35.962371+0000) 2021-08-03T13:10:36.061 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:36.055+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.055984+0000) 2021-08-03T13:10:36.078 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:36.072+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.073013+0000) 2021-08-03T13:10:36.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:36.258+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.258882+0000) 2021-08-03T13:10:36.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:36.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.396438+0000) 2021-08-03T13:10:36.799 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:36.793+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.794060+0000) 2021-08-03T13:10:36.923 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:36.917+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.918653+0000) 2021-08-03T13:10:36.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:36.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.962504+0000) 2021-08-03T13:10:36.970 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:36.964+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:36.965564+0000) 2021-08-03T13:10:37.064 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:37.055+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.056797+0000) 2021-08-03T13:10:37.078 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:37.073+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.073787+0000) 2021-08-03T13:10:37.237 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:37.230+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.231224+0000) 2021-08-03T13:10:37.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:37.258+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.259030+0000) 2021-08-03T13:10:37.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:37.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.396544+0000) 2021-08-03T13:10:37.438 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:37.311+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9772 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:37.799 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:37.794+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.794739+0000) 2021-08-03T13:10:37.924 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:37.919+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.920039+0000) 2021-08-03T13:10:37.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:37.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.962646+0000) 2021-08-03T13:10:37.971 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:37.965+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:37.966160+0000) 2021-08-03T13:10:38.079 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:38.073+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:38.074344+0000) 2021-08-03T13:10:38.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:38.258+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:38.259172+0000) 2021-08-03T13:10:38.400 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:38.395+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:38.396676+0000) 2021-08-03T13:10:38.637 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:38.630+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4256 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:38.800 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:38.794+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:38.795348+0000) 2021-08-03T13:10:38.925 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:38.920+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:38.921209+0000) 2021-08-03T13:10:38.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:38.961+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:38.962758+0000) 2021-08-03T13:10:38.971 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:38.965+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:38.966681+0000) 2021-08-03T13:10:39.080 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:39.074+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.075024+0000) 2021-08-03T13:10:39.167 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:39.161+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.162073+0000) 2021-08-03T13:10:39.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:39.258+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.259307+0000) 2021-08-03T13:10:39.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:39.396+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.396819+0000) 2021-08-03T13:10:39.800 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:39.795+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.795941+0000) 2021-08-03T13:10:39.926 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:39.921+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.922146+0000) 2021-08-03T13:10:39.966 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:39.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.962935+0000) 2021-08-03T13:10:39.972 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:39.966+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:39.967463+0000) 2021-08-03T13:10:40.081 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:40.075+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:40.076243+0000) 2021-08-03T13:10:40.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:40.258+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:40.259461+0000) 2021-08-03T13:10:40.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:40.396+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:40.396954+0000) 2021-08-03T13:10:40.801 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:40.795+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:40.796539+0000) 2021-08-03T13:10:40.927 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:40.922+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:40.923372+0000) 2021-08-03T13:10:40.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:40.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:40.963069+0000) 2021-08-03T13:10:40.973 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:40.967+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:40.968174+0000) 2021-08-03T13:10:41.081 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:41.076+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:41.076766+0000) 2021-08-03T13:10:41.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:41.258+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:41.259598+0000) 2021-08-03T13:10:41.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:41.396+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:41.397103+0000) 2021-08-03T13:10:41.802 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:41.796+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:41.797135+0000) 2021-08-03T13:10:41.930 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:41.924+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:41.925439+0000) 2021-08-03T13:10:41.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:41.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:41.963210+0000) 2021-08-03T13:10:41.973 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:41.968+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:41.968780+0000) 2021-08-03T13:10:42.082 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:42.076+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:42.077349+0000) 2021-08-03T13:10:42.263 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:42.258+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:42.259749+0000) 2021-08-03T13:10:42.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:42.396+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:42.397211+0000) 2021-08-03T13:10:42.802 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:42.796+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:42.797704+0000) 2021-08-03T13:10:42.931 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:42.925+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:42.926586+0000) 2021-08-03T13:10:42.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:42.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:42.963375+0000) 2021-08-03T13:10:42.974 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:42.968+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:42.969511+0000) 2021-08-03T13:10:43.083 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:43.077+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.078260+0000) 2021-08-03T13:10:43.264 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:43.259+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.259898+0000) 2021-08-03T13:10:43.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:43.396+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.397310+0000) 2021-08-03T13:10:43.803 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:43.797+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.798275+0000) 2021-08-03T13:10:43.877 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:43.872+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.872873+0000) 2021-08-03T13:10:43.932 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:43.926+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.927534+0000) 2021-08-03T13:10:43.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:43.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.963501+0000) 2021-08-03T13:10:43.974 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:43.969+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:43.970118+0000) 2021-08-03T13:10:44.084 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:44.078+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.078985+0000) 2021-08-03T13:10:44.128 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:44.057+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10058 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:44.264 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:44.259+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.260038+0000) 2021-08-03T13:10:44.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:44.396+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.397427+0000) 2021-08-03T13:10:44.803 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:44.798+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.798842+0000) 2021-08-03T13:10:44.879 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:44.873+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.874355+0000) 2021-08-03T13:10:44.933 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:44.927+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.928422+0000) 2021-08-03T13:10:44.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:44.962+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.963656+0000) 2021-08-03T13:10:44.975 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:44.970+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:44.970747+0000) 2021-08-03T13:10:45.031 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:44.489+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9781 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:45.401 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:45.396+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:45.397542+0000) 2021-08-03T13:10:45.668 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:45.661+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:45.661801+0000) 2021-08-03T13:10:45.804 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:45.798+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:45.799431+0000) 2021-08-03T13:10:45.880 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:45.874+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:45.875541+0000) 2021-08-03T13:10:45.933 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:45.928+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:45.929441+0000) 2021-08-03T13:10:45.976 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:45.970+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:45.971399+0000) 2021-08-03T13:10:46.463 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:45.976+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4258 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:46.805 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:46.799+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:46.800279+0000) 2021-08-03T13:10:46.881 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:46.875+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:46.876611+0000) 2021-08-03T13:10:46.976 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:46.971+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:46.972210+0000) 2021-08-03T13:10:47.093 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:47.088+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:47.089196+0000) 2021-08-03T13:10:47.623 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:47.616+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:47.617365+0000) 2021-08-03T13:10:47.805 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:47.800+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:47.800977+0000) 2021-08-03T13:10:47.882 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:47.877+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:47.877861+0000) 2021-08-03T13:10:47.978 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:47.972+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:47.973007+0000) 2021-08-03T13:10:48.040 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:48.035+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.035974+0000) 2021-08-03T13:10:48.059 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:48.054+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.055610+0000) 2021-08-03T13:10:48.258 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:48.250+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.251088+0000) 2021-08-03T13:10:48.633 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:48.628+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.628863+0000) 2021-08-03T13:10:48.806 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:48.800+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.801550+0000) 2021-08-03T13:10:48.869 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:48.862+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.863460+0000) 2021-08-03T13:10:48.883 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:48.878+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.879008+0000) 2021-08-03T13:10:48.978 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:48.972+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:48.973608+0000) 2021-08-03T13:10:49.223 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:49.218+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:49.219712+0000) 2021-08-03T13:10:49.807 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:49.801+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:49.802324+0000) 2021-08-03T13:10:49.885 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:49.879+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:49.880174+0000) 2021-08-03T13:10:49.979 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:49.973+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:49.974216+0000) 2021-08-03T13:10:50.808 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:50.802+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:50.803182+0000) 2021-08-03T13:10:50.885 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:50.880+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:50.881067+0000) 2021-08-03T13:10:50.980 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:50.974+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:50.975061+0000) 2021-08-03T13:10:51.180 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:51.123+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10085 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:51.489 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:51.481+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9791 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:51.886 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:51.881+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:51.882004+0000) 2021-08-03T13:10:52.414 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:52.409+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:52.410103+0000) 2021-08-03T13:10:52.888 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:52.882+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:52.882966+0000) 2021-08-03T13:10:53.055 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:53.050+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:53.051544+0000) 2021-08-03T13:10:53.205 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:10:53.198+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:53.199563+0000) 2021-08-03T13:10:53.765 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:53.758+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:53.759509+0000) 2021-08-03T13:10:53.890 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:53.883+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:53.883935+0000) 2021-08-03T13:10:54.412 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:54.405+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:54.406090+0000) 2021-08-03T13:10:54.899 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:10:54.892+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4260 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:10:55.137 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:55.131+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:55.133535+0000) 2021-08-03T13:10:55.291 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:55.285+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:55.286843+0000) 2021-08-03T13:10:55.308 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:10:55.303+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:55.304550+0000) 2021-08-03T13:10:55.378 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:10:55.370+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:55.372616+0000) 2021-08-03T13:10:55.828 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:55.822+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:55.823196+0000) 2021-08-03T13:10:56.291 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:56.285+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:56.286982+0000) 2021-08-03T13:10:56.477 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:10:56.470+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:56.472243+0000) 2021-08-03T13:10:56.484 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:10:56.478+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:56.479178+0000) 2021-08-03T13:10:56.828 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:10:56.823+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:56.823863+0000) 2021-08-03T13:10:56.936 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:10:56.929+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:56.930252+0000) 2021-08-03T13:10:57.083 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:57.077+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:57.078977+0000) 2021-08-03T13:10:57.291 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:57.285+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:57.287090+0000) 2021-08-03T13:10:57.609 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:10:57.601+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10098 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:10:57.928 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:10:57.781+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9818 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:10:58.370 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:10:58.364+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:58.364800+0000) 2021-08-03T13:10:58.697 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:58.691+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:58.693411+0000) 2021-08-03T13:10:59.850 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:10:59.843+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:59.844895+0000) 2021-08-03T13:10:59.951 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:10:59.945+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:10:59.947067+0000) 2021-08-03T13:11:00.123 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:00.116+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:00.117378+0000) 2021-08-03T13:11:00.417 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:00.410+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:00.411746+0000) 2021-08-03T13:11:00.749 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:00.744+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:00.745418+0000) 2021-08-03T13:11:01.644 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:01.570+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4260 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:02.077 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:02.071+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:02.073117+0000) 2021-08-03T13:11:02.139 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:02.133+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:02.135712+0000) 2021-08-03T13:11:02.843 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:02.837+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:02.839297+0000) 2021-08-03T13:11:03.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:03.134+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:03.135869+0000) 2021-08-03T13:11:03.208 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:03.201+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:03.203157+0000) 2021-08-03T13:11:03.843 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:03.837+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:03.839460+0000) 2021-08-03T13:11:04.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:04.135+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:04.135997+0000) 2021-08-03T13:11:04.844 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:04.838+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:04.839613+0000) 2021-08-03T13:11:05.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:05.135+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:05.136154+0000) 2021-08-03T13:11:05.145 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:05.139+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:05.139920+0000) 2021-08-03T13:11:05.844 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:05.838+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:05.839752+0000) 2021-08-03T13:11:06.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:06.135+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:06.136280+0000) 2021-08-03T13:11:06.145 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:06.139+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:06.140605+0000) 2021-08-03T13:11:06.723 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:06.717+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:06.718355+0000) 2021-08-03T13:11:06.844 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:06.839+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:06.839871+0000) 2021-08-03T13:11:06.852 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:06.846+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10108 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:07.161 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:06.997+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9828 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:07.180 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:07.175+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:07.176366+0000) 2021-08-03T13:11:07.240 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:07.235+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:07.236513+0000) 2021-08-03T13:11:07.765 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:07.759+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:07.760164+0000) 2021-08-03T13:11:08.865 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:08.859+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:08.859960+0000) 2021-08-03T13:11:08.945 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:08.938+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:08.939227+0000) 2021-08-03T13:11:09.195 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:09.189+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:09.190787+0000) 2021-08-03T13:11:09.676 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:09.669+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:09.670273+0000) 2021-08-03T13:11:09.676 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:09.669+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:09.669774+0000) 2021-08-03T13:11:09.865 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:09.859+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:09.860624+0000) 2021-08-03T13:11:10.046 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:10.041+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:10.042249+0000) 2021-08-03T13:11:10.228 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:10.157+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4260 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:10.268 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:10.263+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:10.264010+0000) 2021-08-03T13:11:10.706 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:10.700+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:10.700958+0000) 2021-08-03T13:11:10.866 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:10.860+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:10.861200+0000) 2021-08-03T13:11:11.511 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:11.504+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:11.504967+0000) 2021-08-03T13:11:11.517 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:11.511+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:11.512007+0000) 2021-08-03T13:11:11.866 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:11.861+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:11.861764+0000) 2021-08-03T13:11:12.444 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:12.439+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:12.440031+0000) 2021-08-03T13:11:12.867 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:12.861+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:12.862320+0000) 2021-08-03T13:11:13.868 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:13.862+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:13.862860+0000) 2021-08-03T13:11:14.732 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:14.726+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10111 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:14.832 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:14.729+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9830 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:14.868 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:14.862+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:14.863400+0000) 2021-08-03T13:11:15.087 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:15.081+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:15.082561+0000) 2021-08-03T13:11:15.324 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:15.319+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:15.320846+0000) 2021-08-03T13:11:15.869 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:15.863+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:15.863965+0000) 2021-08-03T13:11:16.088 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:16.082+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:16.083245+0000) 2021-08-03T13:11:16.234 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:16.229+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:16.229877+0000) 2021-08-03T13:11:16.370 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:16.364+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:16.364831+0000) 2021-08-03T13:11:16.622 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:16.616+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:16.617334+0000) 2021-08-03T13:11:16.679 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:16.673+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4260 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:16.869 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:16.863+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:16.864533+0000) 2021-08-03T13:11:17.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:17.260+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:17.261659+0000) 2021-08-03T13:11:17.623 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:17.617+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:17.617962+0000) 2021-08-03T13:11:17.846 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:17.839+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:17.840436+0000) 2021-08-03T13:11:17.870 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:17.865+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:17.865850+0000) 2021-08-03T13:11:17.969 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:17.964+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:17.965249+0000) 2021-08-03T13:11:18.265 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:18.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:18.261833+0000) 2021-08-03T13:11:18.623 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:18.617+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:18.618729+0000) 2021-08-03T13:11:18.871 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:18.865+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:18.866365+0000) 2021-08-03T13:11:18.892 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:18.886+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:18.887308+0000) 2021-08-03T13:11:18.969 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:18.964+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:18.965433+0000) 2021-08-03T13:11:19.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:19.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:19.261981+0000) 2021-08-03T13:11:19.624 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:19.618+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:19.619328+0000) 2021-08-03T13:11:19.873 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:19.866+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:19.867142+0000) 2021-08-03T13:11:19.969 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:19.964+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:19.965579+0000) 2021-08-03T13:11:20.183 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:20.176+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:20.177586+0000) 2021-08-03T13:11:20.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:20.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:20.262097+0000) 2021-08-03T13:11:20.278 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:20.237+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9839 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:20.482 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:20.476+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:20.477388+0000) 2021-08-03T13:11:20.625 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:20.619+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:20.620190+0000) 2021-08-03T13:11:20.873 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:20.867+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:20.868040+0000) 2021-08-03T13:11:20.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:20.964+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:20.965713+0000) 2021-08-03T13:11:21.221 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:21.214+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:21.214920+0000) 2021-08-03T13:11:21.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:21.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:21.262249+0000) 2021-08-03T13:11:21.483 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:21.477+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:21.478150+0000) 2021-08-03T13:11:21.626 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:21.619+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:21.621011+0000) 2021-08-03T13:11:21.873 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:21.867+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:21.868605+0000) 2021-08-03T13:11:21.969 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:21.965+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:21.965830+0000) 2021-08-03T13:11:22.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:22.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:22.262356+0000) 2021-08-03T13:11:22.483 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:22.478+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:22.478763+0000) 2021-08-03T13:11:22.626 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:22.619+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:22.621618+0000) 2021-08-03T13:11:22.874 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:22.868+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:22.869195+0000) 2021-08-03T13:11:22.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:22.965+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:22.965999+0000) 2021-08-03T13:11:23.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:23.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:23.262469+0000) 2021-08-03T13:11:23.484 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:23.478+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:23.479376+0000) 2021-08-03T13:11:23.627 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:23.620+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:23.622226+0000) 2021-08-03T13:11:23.673 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:23.668+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:23.669195+0000) 2021-08-03T13:11:23.875 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:23.869+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:23.870253+0000) 2021-08-03T13:11:23.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:23.965+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:23.966106+0000) 2021-08-03T13:11:24.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:24.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:24.262603+0000) 2021-08-03T13:11:24.485 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:24.479+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:24.480376+0000) 2021-08-03T13:11:24.574 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:24.566+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10134 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:24.627 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:24.621+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:24.623242+0000) 2021-08-03T13:11:24.704 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:24.697+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:24.699497+0000) 2021-08-03T13:11:24.876 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:24.870+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:24.871195+0000) 2021-08-03T13:11:24.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:24.965+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:24.966258+0000) 2021-08-03T13:11:25.078 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:25.071+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:25.073047+0000) 2021-08-03T13:11:25.266 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:25.261+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:25.262717+0000) 2021-08-03T13:11:25.485 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:25.480+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:25.481017+0000) 2021-08-03T13:11:25.628 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:25.622+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:25.623893+0000) 2021-08-03T13:11:25.704 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:25.698+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:25.700198+0000) 2021-08-03T13:11:25.878 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:25.871+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:25.872100+0000) 2021-08-03T13:11:25.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:25.965+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:25.966417+0000) 2021-08-03T13:11:26.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:26.262+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:26.262857+0000) 2021-08-03T13:11:26.336 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:26.330+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4260 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:26.488 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:26.482+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:26.482748+0000) 2021-08-03T13:11:26.629 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:26.622+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:26.624486+0000) 2021-08-03T13:11:26.878 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:26.872+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:26.873245+0000) 2021-08-03T13:11:26.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:26.965+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:26.966545+0000) 2021-08-03T13:11:27.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:27.262+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:27.263025+0000) 2021-08-03T13:11:27.630 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:27.623+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:27.625122+0000) 2021-08-03T13:11:27.781 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:27.734+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9843 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:27.879 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:27.873+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:27.874155+0000) 2021-08-03T13:11:27.916 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:27.908+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:27.910180+0000) 2021-08-03T13:11:27.970 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:27.965+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:27.966656+0000) 2021-08-03T13:11:28.267 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:28.262+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:28.263163+0000) 2021-08-03T13:11:28.427 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:28.421+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:28.423163+0000) 2021-08-03T13:11:28.631 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:28.624+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:28.626165+0000) 2021-08-03T13:11:28.881 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:28.874+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:28.875292+0000) 2021-08-03T13:11:28.971 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:28.966+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:28.966791+0000) 2021-08-03T13:11:29.304 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:29.297+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:29.297940+0000) 2021-08-03T13:11:29.427 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:29.422+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:29.423318+0000) 2021-08-03T13:11:29.486 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:29.479+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:29.480338+0000) 2021-08-03T13:11:29.910 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:29.903+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:29.903999+0000) 2021-08-03T13:11:29.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:29.969+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:29.970548+0000) 2021-08-03T13:11:30.126 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:30.121+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:30.122516+0000) 2021-08-03T13:11:30.161 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:30.155+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:30.155785+0000) 2021-08-03T13:11:30.403 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:30.398+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:30.399312+0000) 2021-08-03T13:11:30.427 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:30.422+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:30.423456+0000) 2021-08-03T13:11:30.537 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:30.472+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10148 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:30.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:30.584+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:30.584942+0000) 2021-08-03T13:11:30.974 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:30.968+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:30.969757+0000) 2021-08-03T13:11:31.340 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:31.333+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:31.333858+0000) 2021-08-03T13:11:31.403 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:31.398+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:31.399479+0000) 2021-08-03T13:11:31.427 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:31.422+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:31.423612+0000) 2021-08-03T13:11:31.429 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:31.422+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:31.423654+0000) 2021-08-03T13:11:31.470 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:31.462+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:31.463118+0000) 2021-08-03T13:11:31.651 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:31.565+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4260 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:32.403 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:32.398+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:32.399631+0000) 2021-08-03T13:11:32.427 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:32.422+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:32.423750+0000) 2021-08-03T13:11:32.755 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:32.749+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:32.749969+0000) 2021-08-03T13:11:33.427 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:33.423+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:33.423896+0000) 2021-08-03T13:11:34.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:34.423+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:34.424014+0000) 2021-08-03T13:11:34.737 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:34.730+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9860 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:34.967 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:34.962+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:34.963362+0000) 2021-08-03T13:11:35.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:35.423+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:35.424142+0000) 2021-08-03T13:11:36.017 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:36.012+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.013568+0000) 2021-08-03T13:11:36.385 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:36.379+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.380389+0000) 2021-08-03T13:11:36.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:36.423+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.424299+0000) 2021-08-03T13:11:36.535 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:36.528+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.529546+0000) 2021-08-03T13:11:36.536 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:36.528+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.529622+0000) 2021-08-03T13:11:36.633 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:36.627+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.628715+0000) 2021-08-03T13:11:36.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:36.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.717231+0000) 2021-08-03T13:11:36.890 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:36.883+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:36.883867+0000) 2021-08-03T13:11:37.017 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:37.012+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:37.013682+0000) 2021-08-03T13:11:37.385 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:37.380+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:37.380988+0000) 2021-08-03T13:11:37.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:37.423+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:37.424440+0000) 2021-08-03T13:11:37.634 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:37.628+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:37.629356+0000) 2021-08-03T13:11:37.691 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:37.684+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:37.685548+0000) 2021-08-03T13:11:37.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:37.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:37.717387+0000) 2021-08-03T13:11:37.898 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:37.641+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10155 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:38.018 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:38.013+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.013816+0000) 2021-08-03T13:11:38.052 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:38.047+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.048459+0000) 2021-08-03T13:11:38.076 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:38.070+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.071108+0000) 2021-08-03T13:11:38.387 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:38.381+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.382108+0000) 2021-08-03T13:11:38.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:38.423+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.424581+0000) 2021-08-03T13:11:38.635 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:38.629+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.629922+0000) 2021-08-03T13:11:38.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:38.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.717522+0000) 2021-08-03T13:11:38.764 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:38.757+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:38.758668+0000) 2021-08-03T13:11:39.076 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:39.071+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:39.071894+0000) 2021-08-03T13:11:39.387 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:39.382+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:39.382841+0000) 2021-08-03T13:11:39.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:39.423+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:39.424739+0000) 2021-08-03T13:11:39.636 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:39.629+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:39.630490+0000) 2021-08-03T13:11:39.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:39.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:39.717647+0000) 2021-08-03T13:11:39.835 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:39.768+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4260 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:39.927 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:39.922+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:39.923364+0000) 2021-08-03T13:11:40.077 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:40.071+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:40.072362+0000) 2021-08-03T13:11:40.388 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:40.382+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:40.383475+0000) 2021-08-03T13:11:40.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:40.424+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:40.424880+0000) 2021-08-03T13:11:40.589 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:40.582+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:40.583230+0000) 2021-08-03T13:11:40.636 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:40.630+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:40.631490+0000) 2021-08-03T13:11:40.721 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:40.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:40.717767+0000) 2021-08-03T13:11:41.002 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:40.576+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9863 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:41.064 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:41.059+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:41.060091+0000) 2021-08-03T13:11:41.077 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:41.072+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:41.072981+0000) 2021-08-03T13:11:41.389 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:41.383+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:41.384311+0000) 2021-08-03T13:11:41.428 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:41.424+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:41.425022+0000) 2021-08-03T13:11:41.637 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:41.631+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:41.632085+0000) 2021-08-03T13:11:41.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:41.717+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:41.717916+0000) 2021-08-03T13:11:42.079 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:42.072+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:42.073597+0000) 2021-08-03T13:11:42.390 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:42.384+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:42.385175+0000) 2021-08-03T13:11:42.429 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:42.424+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:42.425202+0000) 2021-08-03T13:11:42.637 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:42.631+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:42.632707+0000) 2021-08-03T13:11:42.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:42.717+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:42.718042+0000) 2021-08-03T13:11:43.080 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:43.074+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:43.075449+0000) 2021-08-03T13:11:43.390 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:43.385+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:43.385988+0000) 2021-08-03T13:11:43.429 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:43.424+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:43.425365+0000) 2021-08-03T13:11:43.638 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:43.632+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:43.633291+0000) 2021-08-03T13:11:43.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:43.717+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:43.718153+0000) 2021-08-03T13:11:44.081 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:44.075+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:44.076064+0000) 2021-08-03T13:11:44.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:44.331+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:44.333611+0000) 2021-08-03T13:11:44.391 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:44.385+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:44.386582+0000) 2021-08-03T13:11:44.429 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:44.424+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:44.425515+0000) 2021-08-03T13:11:44.639 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:44.632+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:44.633947+0000) 2021-08-03T13:11:44.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:44.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:44.718294+0000) 2021-08-03T13:11:44.898 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:44.891+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:44.893389+0000) 2021-08-03T13:11:45.081 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:45.076+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.076922+0000) 2021-08-03T13:11:45.250 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:45.179+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10176 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:45.391 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:45.386+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.387388+0000) 2021-08-03T13:11:45.429 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:45.424+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.425667+0000) 2021-08-03T13:11:45.450 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:45.442+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.444650+0000) 2021-08-03T13:11:45.639 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:45.632+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.634518+0000) 2021-08-03T13:11:45.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:45.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.718426+0000) 2021-08-03T13:11:45.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:45.762+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.764212+0000) 2021-08-03T13:11:45.899 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:45.892+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:45.894125+0000) 2021-08-03T13:11:46.110 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:46.104+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.106565+0000) 2021-08-03T13:11:46.392 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:46.387+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.388009+0000) 2021-08-03T13:11:46.429 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:46.424+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.425831+0000) 2021-08-03T13:11:46.579 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:46.453+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9867 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:46.640 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:46.633+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.635239+0000) 2021-08-03T13:11:46.700 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:46.694+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.696157+0000) 2021-08-03T13:11:46.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:46.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.718577+0000) 2021-08-03T13:11:46.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:46.731+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.733292+0000) 2021-08-03T13:11:46.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:46.762+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.764325+0000) 2021-08-03T13:11:46.899 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:46.892+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:46.894519+0000) 2021-08-03T13:11:47.092 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:47.085+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.087222+0000) 2021-08-03T13:11:47.121 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:47.115+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.117755+0000) 2021-08-03T13:11:47.147 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:47.139+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.141463+0000) 2021-08-03T13:11:47.192 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:46.679+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4262 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:47.241 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:47.235+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.236577+0000) 2021-08-03T13:11:47.366 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:47.359+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.360064+0000) 2021-08-03T13:11:47.393 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:47.388+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.388798+0000) 2021-08-03T13:11:47.429 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:47.425+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.425973+0000) 2021-08-03T13:11:47.641 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:47.634+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.635884+0000) 2021-08-03T13:11:47.703 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:47.697+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.699605+0000) 2021-08-03T13:11:47.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:47.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.718678+0000) 2021-08-03T13:11:47.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:47.731+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.733421+0000) 2021-08-03T13:11:47.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:47.762+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.764447+0000) 2021-08-03T13:11:47.900 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:47.893+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:47.895170+0000) 2021-08-03T13:11:48.095 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:48.088+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.090231+0000) 2021-08-03T13:11:48.242 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:48.236+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.237562+0000) 2021-08-03T13:11:48.394 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:48.388+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.389435+0000) 2021-08-03T13:11:48.429 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:48.425+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.426120+0000) 2021-08-03T13:11:48.641 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:48.634+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.636593+0000) 2021-08-03T13:11:48.706 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:48.700+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.702127+0000) 2021-08-03T13:11:48.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:48.716+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.718780+0000) 2021-08-03T13:11:48.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:48.731+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.733550+0000) 2021-08-03T13:11:48.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:48.762+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.764530+0000) 2021-08-03T13:11:48.900 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:48.894+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:48.895821+0000) 2021-08-03T13:11:49.097 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:49.090+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.091911+0000) 2021-08-03T13:11:49.243 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:49.237+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.238497+0000) 2021-08-03T13:11:49.256 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:49.251+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.252449+0000) 2021-08-03T13:11:49.395 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:49.389+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.390154+0000) 2021-08-03T13:11:49.642 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:49.635+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.637702+0000) 2021-08-03T13:11:49.708 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:49.702+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.704688+0000) 2021-08-03T13:11:49.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:49.717+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.718931+0000) 2021-08-03T13:11:49.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:49.731+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.733676+0000) 2021-08-03T13:11:49.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:49.762+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.764692+0000) 2021-08-03T13:11:49.901 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:49.894+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:49.896401+0000) 2021-08-03T13:11:50.097 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:50.090+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.092496+0000) 2021-08-03T13:11:50.243 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:50.238+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.239068+0000) 2021-08-03T13:11:50.396 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:50.390+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.391162+0000) 2021-08-03T13:11:50.643 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:50.636+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.638618+0000) 2021-08-03T13:11:50.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:50.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.704905+0000) 2021-08-03T13:11:50.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:50.717+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.719058+0000) 2021-08-03T13:11:50.737 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:50.732+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.733801+0000) 2021-08-03T13:11:50.768 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:50.762+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.764799+0000) 2021-08-03T13:11:50.902 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:50.895+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:50.897328+0000) 2021-08-03T13:11:51.098 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:51.091+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.093439+0000) 2021-08-03T13:11:51.244 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:51.238+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.239638+0000) 2021-08-03T13:11:51.396 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:51.391+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.391902+0000) 2021-08-03T13:11:51.644 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:51.637+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.639361+0000) 2021-08-03T13:11:51.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:51.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.705043+0000) 2021-08-03T13:11:51.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:51.717+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.719182+0000) 2021-08-03T13:11:51.738 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:51.732+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.733939+0000) 2021-08-03T13:11:51.769 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:51.763+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.764938+0000) 2021-08-03T13:11:51.902 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:51.896+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:51.897932+0000) 2021-08-03T13:11:51.973 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:51.965+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4264 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:52.099 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:52.092+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.094063+0000) 2021-08-03T13:11:52.245 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:52.239+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.240492+0000) 2021-08-03T13:11:52.393 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:52.167+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10176 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:52.397 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:52.391+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.392499+0000) 2021-08-03T13:11:52.645 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:52.638+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.639929+0000) 2021-08-03T13:11:52.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:52.703+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.705260+0000) 2021-08-03T13:11:52.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:52.717+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.719290+0000) 2021-08-03T13:11:52.769 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:52.763+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.765067+0000) 2021-08-03T13:11:52.903 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:52.896+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:52.898526+0000) 2021-08-03T13:11:53.099 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:53.092+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.094616+0000) 2021-08-03T13:11:53.246 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:53.240+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.241421+0000) 2021-08-03T13:11:53.398 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:53.392+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.393308+0000) 2021-08-03T13:11:53.543 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:53.538+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.539208+0000) 2021-08-03T13:11:53.647 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:53.639+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.640491+0000) 2021-08-03T13:11:53.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:53.704+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.705410+0000) 2021-08-03T13:11:53.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:53.718+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.719421+0000) 2021-08-03T13:11:53.769 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:53.764+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.765194+0000) 2021-08-03T13:11:53.857 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:11:53.851+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:53.852340+0000) 2021-08-03T13:11:53.918 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:53.851+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9871 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:11:54.100 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:54.094+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:54.095364+0000) 2021-08-03T13:11:54.246 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:54.241+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:54.241986+0000) 2021-08-03T13:11:54.398 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:54.393+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:54.393951+0000) 2021-08-03T13:11:54.646 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:54.640+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:54.641044+0000) 2021-08-03T13:11:54.709 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:54.704+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:54.705619+0000) 2021-08-03T13:11:54.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:54.718+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:54.719552+0000) 2021-08-03T13:11:55.100 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:55.095+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.095948+0000) 2021-08-03T13:11:55.119 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:11:55.114+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.115609+0000) 2021-08-03T13:11:55.247 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:55.241+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.242564+0000) 2021-08-03T13:11:55.399 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:55.393+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.394528+0000) 2021-08-03T13:11:55.420 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:55.414+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.414920+0000) 2021-08-03T13:11:55.647 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:55.640+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.641587+0000) 2021-08-03T13:11:55.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:55.704+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.705761+0000) 2021-08-03T13:11:55.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:55.718+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:55.719670+0000) 2021-08-03T13:11:56.101 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:56.095+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.096534+0000) 2021-08-03T13:11:56.247 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:56.242+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.243165+0000) 2021-08-03T13:11:56.401 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:56.395+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.396133+0000) 2021-08-03T13:11:56.647 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:56.641+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.642147+0000) 2021-08-03T13:11:56.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:56.705+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.705964+0000) 2021-08-03T13:11:56.711 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:56.705+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.706251+0000) 2021-08-03T13:11:56.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:56.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.719798+0000) 2021-08-03T13:11:56.727 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:11:56.720+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:56.721640+0000) 2021-08-03T13:11:57.102 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:57.096+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:57.097113+0000) 2021-08-03T13:11:57.248 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:57.242+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:57.243761+0000) 2021-08-03T13:11:57.401 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:57.395+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:57.396721+0000) 2021-08-03T13:11:57.647 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:57.642+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:57.642885+0000) 2021-08-03T13:11:57.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:57.705+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:57.706087+0000) 2021-08-03T13:11:57.711 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:57.706+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:57.706945+0000) 2021-08-03T13:11:57.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:57.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:57.719915+0000) 2021-08-03T13:11:58.102 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:11:58.097+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.097811+0000) 2021-08-03T13:11:58.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:58.226+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.226897+0000) 2021-08-03T13:11:58.249 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:11:58.243+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.244468+0000) 2021-08-03T13:11:58.403 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:11:58.396+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.397683+0000) 2021-08-03T13:11:58.423 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:11:58.398+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10176 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:11:58.648 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:11:58.642+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.643448+0000) 2021-08-03T13:11:58.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:58.705+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.706370+0000) 2021-08-03T13:11:58.712 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:11:58.706+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.707548+0000) 2021-08-03T13:11:58.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:58.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:58.720033+0000) 2021-08-03T13:11:59.391 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:11:57.860+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4264 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:11:59.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:59.392+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:59.393711+0000) 2021-08-03T13:11:59.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:11:59.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:59.720169+0000) 2021-08-03T13:11:59.829 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:11:59.823+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:11:59.823770+0000) 2021-08-03T13:12:00.340 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:11:59.861+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9877 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:00.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:00.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:00.720306+0000) 2021-08-03T13:12:00.829 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:00.823+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:00.824469+0000) 2021-08-03T13:12:00.951 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:00.944+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:00.945472+0000) 2021-08-03T13:12:01.230 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:01.223+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:01.223753+0000) 2021-08-03T13:12:01.372 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:01.366+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:01.366867+0000) 2021-08-03T13:12:01.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:01.514+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:01.515545+0000) 2021-08-03T13:12:01.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:01.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:01.720433+0000) 2021-08-03T13:12:01.829 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:01.824+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:01.825056+0000) 2021-08-03T13:12:01.938 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:12:01.931+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:01.932369+0000) 2021-08-03T13:12:02.292 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:02.286+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:02.286840+0000) 2021-08-03T13:12:02.454 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:02.449+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:02.449881+0000) 2021-08-03T13:12:02.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:02.514+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:02.515687+0000) 2021-08-03T13:12:02.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:02.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:02.720582+0000) 2021-08-03T13:12:02.828 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:02.822+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:02.823191+0000) 2021-08-03T13:12:02.830 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:02.824+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:02.825614+0000) 2021-08-03T13:12:03.486 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:03.480+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:03.480997+0000) 2021-08-03T13:12:03.519 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:03.515+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:03.515836+0000) 2021-08-03T13:12:03.725 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:03.719+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:03.720738+0000) 2021-08-03T13:12:04.074 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:04.068+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:04.068918+0000) 2021-08-03T13:12:04.520 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:04.515+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:04.515965+0000) 2021-08-03T13:12:04.725 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:04.720+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:04.720895+0000) 2021-08-03T13:12:04.874 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:04.869+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:04.870190+0000) 2021-08-03T13:12:05.080 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:04.935+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4266 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:05.382 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:05.100+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10190 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:05.583 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:05.578+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:05.578956+0000) 2021-08-03T13:12:05.861 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:05.856+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:05.857343+0000) 2021-08-03T13:12:06.071 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:06.066+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:06.067641+0000) 2021-08-03T13:12:06.157 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:06.151+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:06.152403+0000) 2021-08-03T13:12:06.216 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:06.210+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:06.210970+0000) 2021-08-03T13:12:06.405 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:06.399+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:06.400546+0000) 2021-08-03T13:12:06.565 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:06.560+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:06.560953+0000) 2021-08-03T13:12:07.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:07.066+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:07.067756+0000) 2021-08-03T13:12:07.158 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:07.152+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:07.153251+0000) 2021-08-03T13:12:07.329 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:07.214+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9899 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:07.407 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:07.401+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:07.402359+0000) 2021-08-03T13:12:08.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:08.067+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:08.067913+0000) 2021-08-03T13:12:08.158 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:08.153+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:08.154071+0000) 2021-08-03T13:12:08.407 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:08.402+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:08.402922+0000) 2021-08-03T13:12:08.422 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:08.417+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:08.418542+0000) 2021-08-03T13:12:08.877 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:08.871+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:08.872555+0000) 2021-08-03T13:12:09.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:09.067+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:09.068062+0000) 2021-08-03T13:12:09.159 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:09.153+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:09.154673+0000) 2021-08-03T13:12:09.408 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:09.403+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:09.403978+0000) 2021-08-03T13:12:10.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:10.067+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:10.068171+0000) 2021-08-03T13:12:10.151 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:10.055+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4268 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:10.160 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:10.154+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:10.155727+0000) 2021-08-03T13:12:10.409 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:10.403+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:10.404545+0000) 2021-08-03T13:12:11.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:11.067+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:11.068287+0000) 2021-08-03T13:12:11.160 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:11.155+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:11.156313+0000) 2021-08-03T13:12:11.410 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:11.404+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:11.405132+0000) 2021-08-03T13:12:11.490 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:11.483+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:11.484542+0000) 2021-08-03T13:12:12.072 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:12.067+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:12.068437+0000) 2021-08-03T13:12:12.076 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:12.028+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10215 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:12.270 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:12.265+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:12.266291+0000) 2021-08-03T13:12:12.410 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:12.404+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:12.405715+0000) 2021-08-03T13:12:12.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:12.470+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:12.471263+0000) 2021-08-03T13:12:12.874 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:12.869+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:12.870652+0000) 2021-08-03T13:12:13.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:13.470+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:13.471394+0000) 2021-08-03T13:12:13.476 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:13.470+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:13.471426+0000) 2021-08-03T13:12:13.635 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:13.534+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9903 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:14.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:14.470+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:14.471541+0000) 2021-08-03T13:12:14.527 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:14.521+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:14.521949+0000) 2021-08-03T13:12:14.735 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:14.728+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:14.729716+0000) 2021-08-03T13:12:14.847 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:14.841+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:14.842107+0000) 2021-08-03T13:12:15.283 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:15.278+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:15.279155+0000) 2021-08-03T13:12:15.475 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:15.470+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:15.471683+0000) 2021-08-03T13:12:15.999 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:15.994+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:15.995162+0000) 2021-08-03T13:12:16.085 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:16.080+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:16.081050+0000) 2021-08-03T13:12:16.100 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:16.095+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:16.096443+0000) 2021-08-03T13:12:16.303 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:16.154+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4268 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:16.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:16.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:16.471831+0000) 2021-08-03T13:12:16.620 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:16.613+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:16.614058+0000) 2021-08-03T13:12:17.086 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:17.081+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:17.081998+0000) 2021-08-03T13:12:17.225 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:17.220+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:17.221242+0000) 2021-08-03T13:12:17.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:17.259+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:17.260401+0000) 2021-08-03T13:12:17.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:17.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:17.471968+0000) 2021-08-03T13:12:18.087 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:18.081+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:18.082587+0000) 2021-08-03T13:12:18.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:18.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:18.472102+0000) 2021-08-03T13:12:18.914 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:18.909+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:18.909872+0000) 2021-08-03T13:12:18.963 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:18.957+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:18.958200+0000) 2021-08-03T13:12:19.087 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:19.082+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:19.083159+0000) 2021-08-03T13:12:19.106 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:19.101+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:19.101868+0000) 2021-08-03T13:12:19.252 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:19.247+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:19.247870+0000) 2021-08-03T13:12:19.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:19.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:19.472250+0000) 2021-08-03T13:12:19.599 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:19.594+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:19.595143+0000) 2021-08-03T13:12:19.600 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:19.511+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9912 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:19.706 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:19.648+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10226 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:19.710 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:19.706+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:19.706812+0000) 2021-08-03T13:12:20.093 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:20.088+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:20.089172+0000) 2021-08-03T13:12:20.107 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:20.102+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:20.103069+0000) 2021-08-03T13:12:20.166 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:20.160+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:20.160761+0000) 2021-08-03T13:12:20.427 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:20.420+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:20.421518+0000) 2021-08-03T13:12:20.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:20.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:20.472373+0000) 2021-08-03T13:12:20.985 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:20.978+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:20.979239+0000) 2021-08-03T13:12:21.109 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:21.103+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:21.104021+0000) 2021-08-03T13:12:21.166 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:21.160+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:21.161527+0000) 2021-08-03T13:12:21.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:21.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:21.472537+0000) 2021-08-03T13:12:21.539 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:21.534+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:21.535324+0000) 2021-08-03T13:12:21.752 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:21.745+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:21.746499+0000) 2021-08-03T13:12:21.764 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:21.759+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:21.760135+0000) 2021-08-03T13:12:22.109 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:22.104+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.104971+0000) 2021-08-03T13:12:22.167 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:22.161+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.162177+0000) 2021-08-03T13:12:22.231 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:22.224+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.225664+0000) 2021-08-03T13:12:22.310 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:22.305+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.306066+0000) 2021-08-03T13:12:22.388 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:22.382+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.383552+0000) 2021-08-03T13:12:22.468 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:22.437+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4268 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:22.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:22.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.472650+0000) 2021-08-03T13:12:22.764 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:22.759+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.760267+0000) 2021-08-03T13:12:22.946 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:22.939+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:22.940264+0000) 2021-08-03T13:12:23.111 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:23.105+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:23.105968+0000) 2021-08-03T13:12:23.167 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:23.162+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:23.162798+0000) 2021-08-03T13:12:23.477 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:23.471+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:23.472791+0000) 2021-08-03T13:12:23.764 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:23.759+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:23.760408+0000) 2021-08-03T13:12:23.835 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:23.829+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:23.830183+0000) 2021-08-03T13:12:23.909 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:23.903+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:23.903746+0000) 2021-08-03T13:12:24.111 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:24.106+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:24.106955+0000) 2021-08-03T13:12:24.167 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:24.162+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:24.163162+0000) 2021-08-03T13:12:24.477 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:24.472+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:24.472936+0000) 2021-08-03T13:12:24.835 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:24.830+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:24.830878+0000) 2021-08-03T13:12:24.909 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:24.903+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:24.904492+0000) 2021-08-03T13:12:25.039 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:24.968+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10229 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:25.113 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:25.107+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:25.108202+0000) 2021-08-03T13:12:25.168 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:25.163+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:25.163702+0000) 2021-08-03T13:12:25.276 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:25.271+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:25.272799+0000) 2021-08-03T13:12:25.477 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:25.472+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:25.473088+0000) 2021-08-03T13:12:25.836 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:25.830+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:25.831460+0000) 2021-08-03T13:12:25.910 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:25.904+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:25.905105+0000) 2021-08-03T13:12:26.114 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:26.108+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:26.109392+0000) 2021-08-03T13:12:26.131 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:26.059+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9925 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:26.169 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:26.163+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:26.164530+0000) 2021-08-03T13:12:26.837 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:26.831+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:26.832217+0000) 2021-08-03T13:12:26.910 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:26.904+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:26.905689+0000) 2021-08-03T13:12:27.115 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:27.109+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:27.110592+0000) 2021-08-03T13:12:27.170 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:27.164+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:27.165156+0000) 2021-08-03T13:12:27.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:27.181+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:27.182187+0000) 2021-08-03T13:12:27.687 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:27.682+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:27.683538+0000) 2021-08-03T13:12:27.837 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:27.832+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:27.832785+0000) 2021-08-03T13:12:27.911 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:27.905+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:27.906473+0000) 2021-08-03T13:12:28.116 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:28.110+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:28.111516+0000) 2021-08-03T13:12:28.170 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:28.165+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:28.165740+0000) 2021-08-03T13:12:28.838 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:28.832+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:28.833374+0000) 2021-08-03T13:12:28.912 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:28.906+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:28.907108+0000) 2021-08-03T13:12:29.120 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:29.111+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:29.112461+0000) 2021-08-03T13:12:29.171 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:29.165+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:29.166316+0000) 2021-08-03T13:12:29.718 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:12:29.710+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:29.711670+0000) 2021-08-03T13:12:29.839 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:29.833+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:29.834155+0000) 2021-08-03T13:12:30.065 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:30.058+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:30.059680+0000) 2021-08-03T13:12:30.146 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:30.141+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:30.142025+0000) 2021-08-03T13:12:30.171 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:30.166+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:30.166884+0000) 2021-08-03T13:12:30.840 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:30.834+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:30.834922+0000) 2021-08-03T13:12:30.875 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:12:30.869+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:30.869984+0000) 2021-08-03T13:12:30.945 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:30.874+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10233 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:30.985 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:30.978+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:30.979506+0000) 2021-08-03T13:12:31.006 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:30.999+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:31.000745+0000) 2021-08-03T13:12:31.146 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:31.141+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:31.142181+0000) 2021-08-03T13:12:31.173 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:31.167+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:31.168452+0000) 2021-08-03T13:12:31.360 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:31.355+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:31.356553+0000) 2021-08-03T13:12:31.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:31.745+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:31.746743+0000) 2021-08-03T13:12:31.840 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:31.834+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:31.835499+0000) 2021-08-03T13:12:32.144 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:32.137+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:32.137806+0000) 2021-08-03T13:12:32.146 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:32.141+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:32.142307+0000) 2021-08-03T13:12:32.174 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:32.168+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:32.169015+0000) 2021-08-03T13:12:32.258 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:31.938+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4268 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:32.693 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:32.635+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9931 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:33.147 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:33.141+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:33.142448+0000) 2021-08-03T13:12:33.174 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:33.168+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:33.169600+0000) 2021-08-03T13:12:33.223 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:33.218+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:33.218954+0000) 2021-08-03T13:12:33.227 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:33.222+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:33.223411+0000) 2021-08-03T13:12:33.631 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:33.625+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:33.626225+0000) 2021-08-03T13:12:34.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:34.221+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:34.223567+0000) 2021-08-03T13:12:34.668 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:34.661+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:34.663163+0000) 2021-08-03T13:12:35.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:35.221+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:35.223686+0000) 2021-08-03T13:12:35.528 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:35.521+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:35.522954+0000) 2021-08-03T13:12:35.724 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:35.716+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:35.718568+0000) 2021-08-03T13:12:36.030 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:36.024+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:36.026390+0000) 2021-08-03T13:12:36.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:36.222+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:36.223840+0000) 2021-08-03T13:12:37.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:37.222+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:37.223979+0000) 2021-08-03T13:12:37.337 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:37.331+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:37.333128+0000) 2021-08-03T13:12:38.228 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:38.222+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:38.224117+0000) 2021-08-03T13:12:38.510 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:38.503+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:38.504994+0000) 2021-08-03T13:12:38.557 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:38.549+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9946 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:39.276 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:39.095+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10270 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:39.553 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:39.547+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:39.549236+0000) 2021-08-03T13:12:39.705 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:39.698+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:39.699957+0000) 2021-08-03T13:12:39.831 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:39.825+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:39.827564+0000) 2021-08-03T13:12:40.501 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:12:40.494+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:40.496119+0000) 2021-08-03T13:12:40.713 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:40.707+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:40.709793+0000) 2021-08-03T13:12:40.931 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:40.924+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:40.926409+0000) 2021-08-03T13:12:41.195 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:41.049+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4271 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:41.469 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:41.463+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:41.465817+0000) 2021-08-03T13:12:41.716 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:41.710+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:41.712184+0000) 2021-08-03T13:12:41.777 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:41.771+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:41.772964+0000) 2021-08-03T13:12:41.932 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:41.925+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:41.927100+0000) 2021-08-03T13:12:41.998 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:41.990+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:41.992587+0000) 2021-08-03T13:12:42.137 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:42.130+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:42.131992+0000) 2021-08-03T13:12:42.292 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:42.284+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:42.286276+0000) 2021-08-03T13:12:42.453 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:42.446+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:42.448588+0000) 2021-08-03T13:12:42.719 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:42.712+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:42.714703+0000) 2021-08-03T13:12:42.746 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:42.738+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:42.740156+0000) 2021-08-03T13:12:42.932 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:42.925+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:42.927678+0000) 2021-08-03T13:12:43.273 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:43.266+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:43.267406+0000) 2021-08-03T13:12:43.454 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:43.448+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:43.449211+0000) 2021-08-03T13:12:43.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:43.718+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:43.719037+0000) 2021-08-03T13:12:43.933 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:43.927+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:43.928234+0000) 2021-08-03T13:12:44.247 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:44.243+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:44.244015+0000) 2021-08-03T13:12:44.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:44.267+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:44.267800+0000) 2021-08-03T13:12:44.454 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:44.449+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:44.449846+0000) 2021-08-03T13:12:44.550 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:44.191+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10275 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:44.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:44.718+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:44.719337+0000) 2021-08-03T13:12:44.764 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:44.759+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:44.760801+0000) 2021-08-03T13:12:44.933 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:44.928+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:44.928832+0000) 2021-08-03T13:12:45.272 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:45.267+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:45.267949+0000) 2021-08-03T13:12:45.455 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:45.449+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:45.450449+0000) 2021-08-03T13:12:45.533 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:12:45.527+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:45.527771+0000) 2021-08-03T13:12:45.536 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:45.529+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:45.530594+0000) 2021-08-03T13:12:45.568 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:45.520+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9948 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:45.723 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:45.718+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:45.719462+0000) 2021-08-03T13:12:45.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:45.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:45.760928+0000) 2021-08-03T13:12:45.934 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:45.928+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:45.929379+0000) 2021-08-03T13:12:46.140 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:46.134+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:46.135043+0000) 2021-08-03T13:12:46.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:46.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:46.761053+0000) 2021-08-03T13:12:46.935 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:46.929+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:46.930121+0000) 2021-08-03T13:12:47.512 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:47.301+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4273 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:47.545 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:47.539+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:47.540410+0000) 2021-08-03T13:12:47.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:47.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:47.761170+0000) 2021-08-03T13:12:47.779 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:47.774+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:47.775546+0000) 2021-08-03T13:12:47.935 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:47.929+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:47.930705+0000) 2021-08-03T13:12:48.414 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:48.408+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:48.409033+0000) 2021-08-03T13:12:48.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:48.440+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:48.441350+0000) 2021-08-03T13:12:48.558 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:48.553+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:48.554516+0000) 2021-08-03T13:12:48.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:48.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:48.761290+0000) 2021-08-03T13:12:48.936 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:48.930+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:48.931262+0000) 2021-08-03T13:12:49.089 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:49.084+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:49.085688+0000) 2021-08-03T13:12:49.092 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:49.086+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:49.086887+0000) 2021-08-03T13:12:49.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:49.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:49.761418+0000) 2021-08-03T13:12:49.969 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:49.962+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:49.962974+0000) 2021-08-03T13:12:50.094 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:50.087+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:50.088380+0000) 2021-08-03T13:12:50.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:50.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:50.761574+0000) 2021-08-03T13:12:51.094 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:51.088+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:51.089388+0000) 2021-08-03T13:12:51.292 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:51.285+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:51.285898+0000) 2021-08-03T13:12:51.319 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:51.297+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10293 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:51.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:51.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:51.761708+0000) 2021-08-03T13:12:52.095 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:52.089+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:52.090411+0000) 2021-08-03T13:12:52.167 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:52.162+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:52.163602+0000) 2021-08-03T13:12:52.242 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:52.237+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:52.238766+0000) 2021-08-03T13:12:52.410 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:52.274+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9951 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:52.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:52.760+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:52.761840+0000) 2021-08-03T13:12:52.845 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:52.839+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:52.840342+0000) 2021-08-03T13:12:52.896 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:12:52.889+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:52.890009+0000) 2021-08-03T13:12:53.316 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:53.309+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.309839+0000) 2021-08-03T13:12:53.317 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:53.311+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.311962+0000) 2021-08-03T13:12:53.485 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:12:53.439+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4278 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:12:53.534 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:53.529+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.530233+0000) 2021-08-03T13:12:53.551 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:53.546+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.547331+0000) 2021-08-03T13:12:53.707 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:53.702+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.703519+0000) 2021-08-03T13:12:53.766 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:53.761+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.761964+0000) 2021-08-03T13:12:53.846 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:53.840+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.841308+0000) 2021-08-03T13:12:53.848 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:12:53.841+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:53.842548+0000) 2021-08-03T13:12:54.509 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:12:54.501+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:54.502647+0000) 2021-08-03T13:12:54.765 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:54.761+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:54.762103+0000) 2021-08-03T13:12:54.847 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:54.841+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:54.842439+0000) 2021-08-03T13:12:54.932 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:54.925+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:54.926295+0000) 2021-08-03T13:12:55.766 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:55.761+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:55.762252+0000) 2021-08-03T13:12:55.848 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:55.842+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:55.843233+0000) 2021-08-03T13:12:56.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:56.098+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:56.099765+0000) 2021-08-03T13:12:56.397 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:56.392+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:56.393299+0000) 2021-08-03T13:12:56.513 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:12:56.505+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10302 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:12:56.692 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:56.686+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:56.687256+0000) 2021-08-03T13:12:56.766 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:56.761+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:56.762393+0000) 2021-08-03T13:12:56.848 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:56.843+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:56.843761+0000) 2021-08-03T13:12:56.872 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:12:56.866+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:56.867282+0000) 2021-08-03T13:12:57.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:57.099+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:57.099889+0000) 2021-08-03T13:12:57.295 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:57.290+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:57.291049+0000) 2021-08-03T13:12:57.485 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:57.478+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:57.478839+0000) 2021-08-03T13:12:57.693 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:57.687+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:57.688012+0000) 2021-08-03T13:12:57.766 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:12:57.761+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:57.762536+0000) 2021-08-03T13:12:57.849 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:12:57.843+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:57.844529+0000) 2021-08-03T13:12:58.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:58.099+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:58.100021+0000) 2021-08-03T13:12:58.693 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:12:58.687+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:58.688562+0000) 2021-08-03T13:12:58.779 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:12:58.772+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9953 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:12:59.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:59.099+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:59.100167+0000) 2021-08-03T13:12:59.792 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:12:59.786+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:59.787208+0000) 2021-08-03T13:12:59.855 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:12:59.850+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:59.850834+0000) 2021-08-03T13:12:59.918 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:12:59.912+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:12:59.913072+0000) 2021-08-03T13:13:00.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:00.099+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:00.100308+0000) 2021-08-03T13:13:00.792 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:00.787+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:00.787872+0000) 2021-08-03T13:13:00.919 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:00.913+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:00.913822+0000) 2021-08-03T13:13:01.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:01.099+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:01.100430+0000) 2021-08-03T13:13:01.404 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:00.728+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4282 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:01.793 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:01.787+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:01.788418+0000) 2021-08-03T13:13:01.912 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:01.907+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:01.908749+0000) 2021-08-03T13:13:01.919 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:01.913+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:01.914435+0000) 2021-08-03T13:13:02.122 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:02.115+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:02.116610+0000) 2021-08-03T13:13:02.794 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:02.788+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:02.789142+0000) 2021-08-03T13:13:02.811 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:02.804+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:02.805415+0000) 2021-08-03T13:13:02.920 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:02.914+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:02.915589+0000) 2021-08-03T13:13:02.961 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:02.917+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10316 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:03.033 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:03.027+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:03.028073+0000) 2021-08-03T13:13:03.063 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:03.056+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:03.057107+0000) 2021-08-03T13:13:03.612 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:03.607+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:03.608138+0000) 2021-08-03T13:13:03.794 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:03.789+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:03.789952+0000) 2021-08-03T13:13:03.921 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:03.915+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:03.916145+0000) 2021-08-03T13:13:03.984 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:03.978+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:03.978993+0000) 2021-08-03T13:13:04.140 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:04.136+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:04.136823+0000) 2021-08-03T13:13:04.795 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:04.789+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:04.790548+0000) 2021-08-03T13:13:04.825 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:04.262+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9955 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:04.921 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:04.916+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:04.916750+0000) 2021-08-03T13:13:05.653 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:05.648+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:05.649490+0000) 2021-08-03T13:13:05.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:05.649+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:05.650347+0000) 2021-08-03T13:13:05.922 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:05.916+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:05.917376+0000) 2021-08-03T13:13:06.297 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:06.292+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:06.293148+0000) 2021-08-03T13:13:06.449 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:06.443+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:06.444302+0000) 2021-08-03T13:13:06.578 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:06.572+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:06.573015+0000) 2021-08-03T13:13:06.724 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:06.719+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:06.720095+0000) 2021-08-03T13:13:06.923 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:06.917+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:06.918088+0000) 2021-08-03T13:13:07.450 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:07.444+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:07.444870+0000) 2021-08-03T13:13:07.522 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:07.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:07.518642+0000) 2021-08-03T13:13:07.726 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:07.721+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:07.722667+0000) 2021-08-03T13:13:07.923 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:07.918+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:07.918732+0000) 2021-08-03T13:13:08.027 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:08.022+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:08.022871+0000) 2021-08-03T13:13:08.317 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:08.310+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:08.311592+0000) 2021-08-03T13:13:08.334 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:08.328+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:08.329567+0000) 2021-08-03T13:13:08.450 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:08.444+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:08.445575+0000) 2021-08-03T13:13:08.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:08.517+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:08.518774+0000) 2021-08-03T13:13:08.730 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:08.725+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:08.726056+0000) 2021-08-03T13:13:08.924 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:08.918+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:08.919307+0000) 2021-08-03T13:13:09.028 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:09.022+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:09.023598+0000) 2021-08-03T13:13:09.043 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:08.932+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4293 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:09.348 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:09.342+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:09.343107+0000) 2021-08-03T13:13:09.451 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:09.445+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:09.446181+0000) 2021-08-03T13:13:09.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:09.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:09.518936+0000) 2021-08-03T13:13:09.732 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:09.727+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:09.728666+0000) 2021-08-03T13:13:09.925 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:09.919+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:09.920031+0000) 2021-08-03T13:13:09.931 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:09.854+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10318 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:10.029 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:10.023+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:10.024458+0000) 2021-08-03T13:13:10.044 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:10.038+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:10.038853+0000) 2021-08-03T13:13:10.261 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:10.255+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:10.256752+0000) 2021-08-03T13:13:10.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:10.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:10.519066+0000) 2021-08-03T13:13:10.925 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:10.920+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:10.920812+0000) 2021-08-03T13:13:11.030 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:11.024+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:11.025304+0000) 2021-08-03T13:13:11.030 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:10.862+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9960 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:11.262 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:11.256+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:11.257473+0000) 2021-08-03T13:13:11.523 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:11.518+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:11.519184+0000) 2021-08-03T13:13:11.628 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:11.620+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:11.621716+0000) 2021-08-03T13:13:11.926 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:11.920+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:11.921430+0000) 2021-08-03T13:13:12.031 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:12.025+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:12.026399+0000) 2021-08-03T13:13:12.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:12.095+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:12.096213+0000) 2021-08-03T13:13:12.806 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:12.801+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:12.802022+0000) 2021-08-03T13:13:12.927 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:12.921+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:12.922453+0000) 2021-08-03T13:13:13.032 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:13.026+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:13.026949+0000) 2021-08-03T13:13:13.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:13.095+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:13.096361+0000) 2021-08-03T13:13:13.927 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:13.922+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:13.923046+0000) 2021-08-03T13:13:14.032 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:14.026+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:14.027673+0000) 2021-08-03T13:13:14.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:14.095+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:14.096497+0000) 2021-08-03T13:13:14.170 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:14.164+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:14.165223+0000) 2021-08-03T13:13:14.441 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:14.436+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:14.437484+0000) 2021-08-03T13:13:14.549 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:14.544+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:14.545063+0000) 2021-08-03T13:13:14.928 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:14.922+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:14.923636+0000) 2021-08-03T13:13:15.032 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:15.027+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:15.028258+0000) 2021-08-03T13:13:15.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:15.095+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:15.096616+0000) 2021-08-03T13:13:15.115 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:15.108+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:15.109485+0000) 2021-08-03T13:13:15.706 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:15.699+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:15.700583+0000) 2021-08-03T13:13:15.929 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:15.923+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:15.924234+0000) 2021-08-03T13:13:16.034 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:16.028+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:16.029199+0000) 2021-08-03T13:13:16.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:16.095+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:16.096753+0000) 2021-08-03T13:13:16.262 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:16.257+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:16.258508+0000) 2021-08-03T13:13:16.406 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:16.401+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:16.402701+0000) 2021-08-03T13:13:16.452 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:16.294+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10327 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:16.930 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:16.924+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:16.925090+0000) 2021-08-03T13:13:17.009 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:17.003+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4303 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:17.034 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:17.028+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:17.029749+0000) 2021-08-03T13:13:17.044 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:17.039+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:17.040363+0000) 2021-08-03T13:13:17.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:17.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:17.096881+0000) 2021-08-03T13:13:17.930 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:17.924+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:17.925673+0000) 2021-08-03T13:13:18.036 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:18.030+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:18.030954+0000) 2021-08-03T13:13:18.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:18.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:18.096989+0000) 2021-08-03T13:13:18.406 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:18.400+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:18.400863+0000) 2021-08-03T13:13:18.526 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:18.369+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9963 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:18.853 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:18.847+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:18.848321+0000) 2021-08-03T13:13:18.931 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:18.925+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:18.926285+0000) 2021-08-03T13:13:19.036 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:19.031+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:19.031930+0000) 2021-08-03T13:13:19.100 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:19.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:19.097128+0000) 2021-08-03T13:13:19.135 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:19.129+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:19.130390+0000) 2021-08-03T13:13:20.101 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:20.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:20.097268+0000) 2021-08-03T13:13:20.641 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:20.636+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:20.637305+0000) 2021-08-03T13:13:21.101 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:21.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:21.097407+0000) 2021-08-03T13:13:21.358 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:21.353+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:21.354656+0000) 2021-08-03T13:13:22.101 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:22.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:22.097545+0000) 2021-08-03T13:13:22.136 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:22.130+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:22.131065+0000) 2021-08-03T13:13:22.648 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:22.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:22.644613+0000) 2021-08-03T13:13:22.965 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:22.958+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:22.959589+0000) 2021-08-03T13:13:23.099 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:23.094+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:23.094891+0000) 2021-08-03T13:13:23.101 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:23.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:23.097694+0000) 2021-08-03T13:13:23.220 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:23.215+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:23.215911+0000) 2021-08-03T13:13:23.649 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:23.642+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:23.644753+0000) 2021-08-03T13:13:23.707 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:23.701+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:23.701867+0000) 2021-08-03T13:13:24.101 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:24.095+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:24.095791+0000) 2021-08-03T13:13:24.102 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:24.096+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:24.097825+0000) 2021-08-03T13:13:24.189 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:24.182+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:24.183744+0000) 2021-08-03T13:13:24.649 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:24.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:24.644905+0000) 2021-08-03T13:13:25.101 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:25.095+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:25.096646+0000) 2021-08-03T13:13:25.102 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:25.097+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:25.097919+0000) 2021-08-03T13:13:25.391 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:25.161+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4305 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:25.401 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:25.393+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10341 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:25.649 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:25.643+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:25.644998+0000) 2021-08-03T13:13:25.666 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:25.659+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:25.660884+0000) 2021-08-03T13:13:25.675 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:25.668+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:25.669934+0000) 2021-08-03T13:13:26.067 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:26.060+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9971 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:26.396 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:26.389+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:26.390802+0000) 2021-08-03T13:13:27.334 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:27.327+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:27.329615+0000) 2021-08-03T13:13:27.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:27.391+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:27.393747+0000) 2021-08-03T13:13:27.402 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:27.395+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:27.396291+0000) 2021-08-03T13:13:28.336 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:28.329+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:28.330906+0000) 2021-08-03T13:13:29.336 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:29.329+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:29.331518+0000) 2021-08-03T13:13:29.845 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:29.839+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:29.841654+0000) 2021-08-03T13:13:30.124 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:30.119+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:30.120478+0000) 2021-08-03T13:13:30.294 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:30.288+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:30.289188+0000) 2021-08-03T13:13:30.337 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:30.330+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:30.332198+0000) 2021-08-03T13:13:30.733 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:30.727+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:30.729235+0000) 2021-08-03T13:13:31.077 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:30.881+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10346 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:31.080 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:31.074+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:31.076727+0000) 2021-08-03T13:13:31.338 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:31.331+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:31.332805+0000) 2021-08-03T13:13:31.736 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:31.730+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:31.731838+0000) 2021-08-03T13:13:31.913 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:31.844+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4305 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:31.921 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:31.915+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:31.916398+0000) 2021-08-03T13:13:32.084 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:31.926+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 9988 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:32.339 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:32.333+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:32.334951+0000) 2021-08-03T13:13:33.080 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:33.073+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:33.074411+0000) 2021-08-03T13:13:33.473 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:33.467+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:33.467928+0000) 2021-08-03T13:13:34.473 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:34.467+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:34.468615+0000) 2021-08-03T13:13:34.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:34.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:34.987182+0000) 2021-08-03T13:13:35.229 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:35.223+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:35.224661+0000) 2021-08-03T13:13:35.440 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:35.433+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:35.434712+0000) 2021-08-03T13:13:35.474 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:35.468+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:35.469462+0000) 2021-08-03T13:13:35.982 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:35.976+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:35.977092+0000) 2021-08-03T13:13:35.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:35.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:35.987337+0000) 2021-08-03T13:13:36.029 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:36.024+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:36.025721+0000) 2021-08-03T13:13:36.230 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:36.224+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:36.225628+0000) 2021-08-03T13:13:36.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:36.769+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:36.770394+0000) 2021-08-03T13:13:36.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:36.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:36.987495+0000) 2021-08-03T13:13:37.225 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:36.984+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10356 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:37.231 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:37.225+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:37.226255+0000) 2021-08-03T13:13:37.362 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:37.357+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:37.358049+0000) 2021-08-03T13:13:37.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:37.769+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:37.770546+0000) 2021-08-03T13:13:37.807 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:37.800+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:37.801784+0000) 2021-08-03T13:13:37.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:37.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:37.987628+0000) 2021-08-03T13:13:38.231 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:38.226+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:38.226826+0000) 2021-08-03T13:13:38.761 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:38.754+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:38.755630+0000) 2021-08-03T13:13:38.774 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:38.769+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:38.770703+0000) 2021-08-03T13:13:38.991 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:38.986+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:38.987769+0000) 2021-08-03T13:13:39.153 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:39.112+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10000 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:39.156 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:39.150+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:39.151355+0000) 2021-08-03T13:13:39.232 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:39.226+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:39.227387+0000) 2021-08-03T13:13:39.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:39.770+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:39.770857+0000) 2021-08-03T13:13:39.795 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:39.694+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4305 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:39.858 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:39.852+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:39.853599+0000) 2021-08-03T13:13:40.775 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:40.770+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:40.771004+0000) 2021-08-03T13:13:40.859 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:40.853+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:40.854299+0000) 2021-08-03T13:13:41.028 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:41.020+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:41.021435+0000) 2021-08-03T13:13:41.119 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:41.112+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:41.113312+0000) 2021-08-03T13:13:41.743 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:41.736+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:41.737646+0000) 2021-08-03T13:13:41.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:41.810+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:41.811121+0000) 2021-08-03T13:13:41.863 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:41.854+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:41.855081+0000) 2021-08-03T13:13:42.120 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:42.115+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:42.116872+0000) 2021-08-03T13:13:42.265 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:42.260+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:42.260915+0000) 2021-08-03T13:13:42.589 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:42.584+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:42.585667+0000) 2021-08-03T13:13:42.854 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:42.848+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:42.849703+0000) 2021-08-03T13:13:42.863 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:42.858+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:42.858918+0000) 2021-08-03T13:13:43.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:43.260+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:43.261635+0000) 2021-08-03T13:13:43.431 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:43.425+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:43.426546+0000) 2021-08-03T13:13:43.864 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:43.858+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:43.859504+0000) 2021-08-03T13:13:44.154 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:44.149+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:44.150239+0000) 2021-08-03T13:13:44.266 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:44.261+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:44.262221+0000) 2021-08-03T13:13:44.480 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:44.474+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:44.475082+0000) 2021-08-03T13:13:44.529 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:44.522+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10358 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:44.718 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:44.711+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:44.712753+0000) 2021-08-03T13:13:44.724 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:44.717+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:44.717975+0000) 2021-08-03T13:13:44.864 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:44.859+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:44.860078+0000) 2021-08-03T13:13:45.267 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:45.261+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:45.262813+0000) 2021-08-03T13:13:45.865 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:45.859+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:45.860446+0000) 2021-08-03T13:13:46.268 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:46.261+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:46.263209+0000) 2021-08-03T13:13:46.866 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:46.860+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:46.861428+0000) 2021-08-03T13:13:46.987 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:46.810+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10020 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:47.268 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:47.262+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:47.263803+0000) 2021-08-03T13:13:47.538 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:47.532+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:47.533280+0000) 2021-08-03T13:13:47.817 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:47.807+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4308 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:49.109 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:49.102+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:49.103842+0000) 2021-08-03T13:13:49.471 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:49.463+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:49.464941+0000) 2021-08-03T13:13:49.476 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:49.471+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:49.471976+0000) 2021-08-03T13:13:49.566 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:13:49.559+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:49.560704+0000) 2021-08-03T13:13:49.729 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:49.724+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:49.725149+0000) 2021-08-03T13:13:49.730 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:49.725+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:49.725977+0000) 2021-08-03T13:13:49.811 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:49.805+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:49.806418+0000) 2021-08-03T13:13:50.099 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:50.093+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:50.093800+0000) 2021-08-03T13:13:50.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:50.194+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:50.195041+0000) 2021-08-03T13:13:50.812 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:50.806+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:50.807347+0000) 2021-08-03T13:13:50.928 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:13:50.919+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:50.921655+0000) 2021-08-03T13:13:50.933 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:50.927+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:50.927931+0000) 2021-08-03T13:13:51.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:51.194+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:51.195167+0000) 2021-08-03T13:13:51.707 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:51.667+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10358 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:51.813 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:51.807+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:51.808103+0000) 2021-08-03T13:13:51.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:51.895+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:51.896369+0000) 2021-08-03T13:13:52.030 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:52.024+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:52.026512+0000) 2021-08-03T13:13:52.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:52.194+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:52.195283+0000) 2021-08-03T13:13:52.813 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:52.807+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:52.808699+0000) 2021-08-03T13:13:52.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:52.895+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:52.896528+0000) 2021-08-03T13:13:53.056 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:53.051+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:53.052571+0000) 2021-08-03T13:13:53.057 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:53.052+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:53.053446+0000) 2021-08-03T13:13:53.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:53.194+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:53.195436+0000) 2021-08-03T13:13:53.900 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:53.895+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:53.896673+0000) 2021-08-03T13:13:53.949 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:53.779+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10037 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:54.199 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:54.194+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:54.195567+0000) 2021-08-03T13:13:54.208 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:13:53.826+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4308 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:13:54.537 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:54.531+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:54.531972+0000) 2021-08-03T13:13:54.951 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:54.944+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:54.945630+0000) 2021-08-03T13:13:55.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:55.194+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:55.195697+0000) 2021-08-03T13:13:55.573 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:55.567+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:55.568792+0000) 2021-08-03T13:13:55.739 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:55.732+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:55.733287+0000) 2021-08-03T13:13:56.109 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:56.103+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:56.104262+0000) 2021-08-03T13:13:56.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:56.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:56.195856+0000) 2021-08-03T13:13:56.360 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:13:56.354+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:56.354863+0000) 2021-08-03T13:13:57.109 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:57.104+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:57.105262+0000) 2021-08-03T13:13:57.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:57.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:57.195989+0000) 2021-08-03T13:13:57.661 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:57.655+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:57.656046+0000) 2021-08-03T13:13:58.110 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:58.105+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:58.105858+0000) 2021-08-03T13:13:58.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:58.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:58.196103+0000) 2021-08-03T13:13:58.435 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:13:58.428+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:58.429746+0000) 2021-08-03T13:13:58.661 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:58.656+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:58.656725+0000) 2021-08-03T13:13:58.850 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:58.845+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:58.846147+0000) 2021-08-03T13:13:59.111 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:13:59.105+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:59.106494+0000) 2021-08-03T13:13:59.181 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:13:59.173+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10358 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:13:59.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:13:59.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:59.196246+0000) 2021-08-03T13:13:59.280 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:59.273+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:59.274372+0000) 2021-08-03T13:13:59.310 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:13:59.304+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10058 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:13:59.662 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:13:59.656+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:59.657344+0000) 2021-08-03T13:13:59.730 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:13:59.724+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:59.725322+0000) 2021-08-03T13:13:59.731 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:13:59.724+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:59.725626+0000) 2021-08-03T13:13:59.932 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:13:59.927+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:13:59.928706+0000) 2021-08-03T13:14:00.113 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:00.106+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:00.107103+0000) 2021-08-03T13:14:00.200 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:00.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:00.196428+0000) 2021-08-03T13:14:00.663 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:00.657+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:00.657801+0000) 2021-08-03T13:14:00.731 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:00.726+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:00.726854+0000) 2021-08-03T13:14:00.811 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:00.651+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4314 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:00.816 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:00.809+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:00.810369+0000) 2021-08-03T13:14:01.113 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:01.107+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:01.108459+0000) 2021-08-03T13:14:01.201 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:01.195+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:01.196565+0000) 2021-08-03T13:14:01.663 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:01.657+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:01.658617+0000) 2021-08-03T13:14:01.732 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:01.727+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:01.727796+0000) 2021-08-03T13:14:01.880 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:01.875+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:01.876109+0000) 2021-08-03T13:14:02.115 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:02.109+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:02.110090+0000) 2021-08-03T13:14:02.214 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:02.209+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:02.210781+0000) 2021-08-03T13:14:02.557 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:02.551+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:02.551972+0000) 2021-08-03T13:14:02.664 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:02.658+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:02.659166+0000) 2021-08-03T13:14:02.734 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:02.727+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:02.728730+0000) 2021-08-03T13:14:03.215 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:03.210+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:03.210937+0000) 2021-08-03T13:14:03.665 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:03.659+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:03.660009+0000) 2021-08-03T13:14:03.734 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:03.728+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:03.729670+0000) 2021-08-03T13:14:04.215 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:04.210+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:04.211071+0000) 2021-08-03T13:14:04.253 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:04.246+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:04.247679+0000) 2021-08-03T13:14:04.665 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:04.659+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:04.660604+0000) 2021-08-03T13:14:04.735 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:04.729+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:04.730712+0000) 2021-08-03T13:14:04.789 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:04.784+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:04.785477+0000) 2021-08-03T13:14:05.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:05.125+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:05.126298+0000) 2021-08-03T13:14:05.137 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:05.131+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:05.132231+0000) 2021-08-03T13:14:05.215 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:05.210+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:05.211225+0000) 2021-08-03T13:14:05.666 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:05.660+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:05.661193+0000) 2021-08-03T13:14:05.736 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:05.730+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:05.731668+0000) 2021-08-03T13:14:06.214 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:06.207+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10074 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:06.215 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:06.210+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:06.211359+0000) 2021-08-03T13:14:06.354 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:06.348+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:06.349770+0000) 2021-08-03T13:14:06.685 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:06.471+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10358 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:06.737 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:06.731+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:06.732660+0000) 2021-08-03T13:14:07.532 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:07.526+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:07.526937+0000) 2021-08-03T13:14:07.739 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:07.732+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:07.733697+0000) 2021-08-03T13:14:07.872 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:07.867+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:07.867851+0000) 2021-08-03T13:14:08.415 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:08.203+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4316 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:08.589 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:08.584+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:08.585311+0000) 2021-08-03T13:14:08.719 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:08.711+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:08.712233+0000) 2021-08-03T13:14:08.739 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:08.733+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:08.734643+0000) 2021-08-03T13:14:08.873 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:08.867+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:08.868540+0000) 2021-08-03T13:14:09.310 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:09.305+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:09.305974+0000) 2021-08-03T13:14:09.740 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:09.734+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:09.735590+0000) 2021-08-03T13:14:10.742 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:10.736+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:10.737093+0000) 2021-08-03T13:14:10.816 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:10.809+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:10.810703+0000) 2021-08-03T13:14:11.743 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:11.737+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:11.738470+0000) 2021-08-03T13:14:11.783 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:11.777+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:11.778113+0000) 2021-08-03T13:14:12.744 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:12.739+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:12.740017+0000) 2021-08-03T13:14:13.410 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:13.402+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:13.403638+0000) 2021-08-03T13:14:13.459 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:13.450+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10099 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:13.746 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:13.740+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:13.740947+0000) 2021-08-03T13:14:14.081 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:14.075+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:14.077078+0000) 2021-08-03T13:14:14.472 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:14.466+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10364 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:14.746 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:14.741+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:14.741899+0000) 2021-08-03T13:14:15.748 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:15.742+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:15.742861+0000) 2021-08-03T13:14:15.950 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:15.697+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4329 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:16.048 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:16.042+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:16.043848+0000) 2021-08-03T13:14:16.134 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:16.127+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:16.129293+0000) 2021-08-03T13:14:16.749 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:16.743+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:16.743794+0000) 2021-08-03T13:14:17.087 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:17.080+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:17.081252+0000) 2021-08-03T13:14:17.388 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:17.382+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:17.384473+0000) 2021-08-03T13:14:18.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:18.382+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:18.384617+0000) 2021-08-03T13:14:18.755 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:18.749+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:18.750826+0000) 2021-08-03T13:14:19.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:19.382+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:19.384741+0000) 2021-08-03T13:14:19.642 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:19.636+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:19.637874+0000) 2021-08-03T13:14:19.665 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:19.657+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:19.659462+0000) 2021-08-03T13:14:19.728 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:19.722+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:19.723006+0000) 2021-08-03T13:14:19.937 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:19.853+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10364 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:20.135 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:20.128+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:20.129954+0000) 2021-08-03T13:14:20.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:20.207+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:20.209752+0000) 2021-08-03T13:14:20.349 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:20.343+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:20.344884+0000) 2021-08-03T13:14:20.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:20.383+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:20.384860+0000) 2021-08-03T13:14:20.549 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:20.544+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:20.545038+0000) 2021-08-03T13:14:20.686 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:20.631+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10110 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:21.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:21.208+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:21.209921+0000) 2021-08-03T13:14:21.294 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:21.288+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:21.289027+0000) 2021-08-03T13:14:21.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:21.383+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:21.384983+0000) 2021-08-03T13:14:21.548 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:21.544+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:21.545162+0000) 2021-08-03T13:14:21.847 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:21.840+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:21.841773+0000) 2021-08-03T13:14:21.860 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:21.853+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:21.855111+0000) 2021-08-03T13:14:21.865 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:21.859+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:21.860245+0000) 2021-08-03T13:14:22.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:22.208+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:22.210046+0000) 2021-08-03T13:14:22.389 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:22.383+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:22.385100+0000) 2021-08-03T13:14:22.549 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:22.544+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:22.545314+0000) 2021-08-03T13:14:22.860 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:22.854+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:22.855821+0000) 2021-08-03T13:14:22.896 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:22.890+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:22.890860+0000) 2021-08-03T13:14:23.034 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:23.026+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4331 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:23.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:23.209+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:23.210169+0000) 2021-08-03T13:14:23.549 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:23.544+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:23.545440+0000) 2021-08-03T13:14:24.157 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:24.152+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:24.153404+0000) 2021-08-03T13:14:24.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:24.209+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:24.210302+0000) 2021-08-03T13:14:24.277 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:24.269+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:24.270647+0000) 2021-08-03T13:14:24.549 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:24.544+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:24.545587+0000) 2021-08-03T13:14:24.992 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:24.987+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:24.987936+0000) 2021-08-03T13:14:25.153 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:25.147+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:25.147863+0000) 2021-08-03T13:14:25.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:25.209+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:25.210449+0000) 2021-08-03T13:14:25.461 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:25.455+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:25.456491+0000) 2021-08-03T13:14:25.549 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:25.544+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:25.545723+0000) 2021-08-03T13:14:25.995 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:25.840+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10378 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:26.550 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:26.545+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:26.545879+0000) 2021-08-03T13:14:27.127 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:27.122+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:27.122895+0000) 2021-08-03T13:14:27.158 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:27.151+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:27.152628+0000) 2021-08-03T13:14:27.359 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:27.354+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:27.355563+0000) 2021-08-03T13:14:27.407 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:27.383+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10110 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:27.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:27.450+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:27.451393+0000) 2021-08-03T13:14:27.661 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:27.655+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:27.655981+0000) 2021-08-03T13:14:28.035 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:28.029+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:28.029818+0000) 2021-08-03T13:14:28.084 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:28.039+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4350 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:28.288 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:28.282+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:28.283042+0000) 2021-08-03T13:14:29.054 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:29.046+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:29.047586+0000) 2021-08-03T13:14:29.404 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:29.398+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:29.399490+0000) 2021-08-03T13:14:29.878 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:29.872+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:29.873625+0000) 2021-08-03T13:14:29.912 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:29.906+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:29.906989+0000) 2021-08-03T13:14:30.104 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:30.099+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:30.100625+0000) 2021-08-03T13:14:30.826 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:30.820+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:30.820830+0000) 2021-08-03T13:14:30.879 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:30.873+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:30.874389+0000) 2021-08-03T13:14:31.423 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:31.417+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:31.418010+0000) 2021-08-03T13:14:31.635 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:31.629+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:31.629835+0000) 2021-08-03T13:14:31.879 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:31.874+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:31.874969+0000) 2021-08-03T13:14:32.880 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:32.874+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:32.875521+0000) 2021-08-03T13:14:33.118 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:33.113+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:33.113993+0000) 2021-08-03T13:14:33.313 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:33.067+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10383 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:33.881 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:33.875+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:33.876270+0000) 2021-08-03T13:14:34.120 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:34.114+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:34.114990+0000) 2021-08-03T13:14:34.152 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:34.145+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:34.145829+0000) 2021-08-03T13:14:34.600 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:34.595+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:34.596190+0000) 2021-08-03T13:14:34.778 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:34.242+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4358 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:34.882 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:34.876+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:34.877009+0000) 2021-08-03T13:14:35.120 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:35.114+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:35.115613+0000) 2021-08-03T13:14:35.548 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:35.542+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10126 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:36.094 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:36.089+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:36.090286+0000) 2021-08-03T13:14:36.284 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:36.278+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:36.279324+0000) 2021-08-03T13:14:37.752 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:37.746+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:37.747152+0000) 2021-08-03T13:14:37.801 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:37.794+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:37.795433+0000) 2021-08-03T13:14:37.826 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:37.821+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:37.822666+0000) 2021-08-03T13:14:38.577 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:38.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:38.573024+0000) 2021-08-03T13:14:38.753 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:38.747+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:38.747867+0000) 2021-08-03T13:14:39.055 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:39.049+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:39.050001+0000) 2021-08-03T13:14:39.153 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:39.146+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:39.147684+0000) 2021-08-03T13:14:39.577 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:39.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:39.573164+0000) 2021-08-03T13:14:39.753 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:39.747+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:39.748483+0000) 2021-08-03T13:14:39.943 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:39.937+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:39.938160+0000) 2021-08-03T13:14:40.056 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:40.050+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:40.051296+0000) 2021-08-03T13:14:40.577 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:40.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:40.573299+0000) 2021-08-03T13:14:40.754 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:40.748+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:40.749101+0000) 2021-08-03T13:14:40.883 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:40.878+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:40.879607+0000) 2021-08-03T13:14:40.943 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:40.938+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:40.939075+0000) 2021-08-03T13:14:41.057 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:41.051+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:41.052263+0000) 2021-08-03T13:14:41.124 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:41.118+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10149 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:41.310 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:41.150+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10383 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:41.577 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:41.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:41.573429+0000) 2021-08-03T13:14:41.754 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:41.749+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:41.749933+0000) 2021-08-03T13:14:41.822 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:41.531+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4362 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:41.883 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:41.878+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:41.879751+0000) 2021-08-03T13:14:41.969 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:14:41.962+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:41.962837+0000) 2021-08-03T13:14:42.058 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:42.052+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:42.053447+0000) 2021-08-03T13:14:42.481 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:42.474+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:42.475149+0000) 2021-08-03T13:14:42.501 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:42.496+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:42.497762+0000) 2021-08-03T13:14:42.577 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:42.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:42.573571+0000) 2021-08-03T13:14:42.756 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:42.750+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:42.751085+0000) 2021-08-03T13:14:42.883 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:42.879+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:42.879875+0000) 2021-08-03T13:14:43.059 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:43.053+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:43.054386+0000) 2021-08-03T13:14:43.286 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:43.279+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:43.279963+0000) 2021-08-03T13:14:43.577 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:43.572+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:43.573693+0000) 2021-08-03T13:14:43.756 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:43.750+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:43.751666+0000) 2021-08-03T13:14:43.883 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:43.879+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:43.880012+0000) 2021-08-03T13:14:44.060 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:44.054+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:44.055324+0000) 2021-08-03T13:14:44.578 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:44.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:44.573853+0000) 2021-08-03T13:14:44.610 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:44.606+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:44.606835+0000) 2021-08-03T13:14:44.741 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:44.735+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:44.735707+0000) 2021-08-03T13:14:44.757 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:44.751+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:44.752409+0000) 2021-08-03T13:14:44.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:44.879+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:44.880141+0000) 2021-08-03T13:14:44.976 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:44.971+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:44.972660+0000) 2021-08-03T13:14:45.061 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:45.055+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:45.056484+0000) 2021-08-03T13:14:45.179 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:45.172+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:45.173258+0000) 2021-08-03T13:14:45.578 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:45.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:45.573994+0000) 2021-08-03T13:14:45.758 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:45.752+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:45.753039+0000) 2021-08-03T13:14:45.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:45.879+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:45.880297+0000) 2021-08-03T13:14:46.062 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:46.057+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:46.057822+0000) 2021-08-03T13:14:46.413 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:46.406+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:46.407286+0000) 2021-08-03T13:14:46.578 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:46.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:46.574112+0000) 2021-08-03T13:14:46.748 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:46.413+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10383 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:46.759 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:46.753+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:46.753853+0000) 2021-08-03T13:14:46.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:46.879+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:46.880416+0000) 2021-08-03T13:14:47.065 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:47.058+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:47.059287+0000) 2021-08-03T13:14:47.148 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:47.143+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:47.144151+0000) 2021-08-03T13:14:47.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:47.402+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:47.403596+0000) 2021-08-03T13:14:47.578 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:47.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:47.574237+0000) 2021-08-03T13:14:47.759 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:47.753+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:47.754664+0000) 2021-08-03T13:14:47.867 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:47.860+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:47.861399+0000) 2021-08-03T13:14:47.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:47.879+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:47.880548+0000) 2021-08-03T13:14:48.065 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:48.060+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.060831+0000) 2021-08-03T13:14:48.161 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:48.155+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.156690+0000) 2021-08-03T13:14:48.215 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:48.209+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.210224+0000) 2021-08-03T13:14:48.276 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:48.271+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.272573+0000) 2021-08-03T13:14:48.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:48.402+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.403718+0000) 2021-08-03T13:14:48.578 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:48.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.574352+0000) 2021-08-03T13:14:48.761 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:48.755+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.756388+0000) 2021-08-03T13:14:48.774 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:48.429+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10152 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:48.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:48.879+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:48.880694+0000) 2021-08-03T13:14:49.069 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:49.061+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.061827+0000) 2021-08-03T13:14:49.215 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:49.210+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.210925+0000) 2021-08-03T13:14:49.279 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:49.273+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.274278+0000) 2021-08-03T13:14:49.407 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:49.403+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.403869+0000) 2021-08-03T13:14:49.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:49.525+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.525939+0000) 2021-08-03T13:14:49.578 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:49.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.574503+0000) 2021-08-03T13:14:49.762 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:49.756+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.757072+0000) 2021-08-03T13:14:49.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:49.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:49.880892+0000) 2021-08-03T13:14:50.067 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:50.062+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.062844+0000) 2021-08-03T13:14:50.216 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:50.210+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.211522+0000) 2021-08-03T13:14:50.226 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:50.220+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.221199+0000) 2021-08-03T13:14:50.279 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:50.274+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.274847+0000) 2021-08-03T13:14:50.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:50.403+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.404015+0000) 2021-08-03T13:14:50.455 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:50.448+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.449572+0000) 2021-08-03T13:14:50.578 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:50.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.574637+0000) 2021-08-03T13:14:50.762 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:50.757+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.757895+0000) 2021-08-03T13:14:50.871 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:50.734+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4367 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:50.884 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:50.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:50.881065+0000) 2021-08-03T13:14:51.068 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:51.063+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:51.063722+0000) 2021-08-03T13:14:51.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:51.274+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:51.275431+0000) 2021-08-03T13:14:51.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:51.573+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:51.574768+0000) 2021-08-03T13:14:51.763 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:51.757+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:51.758439+0000) 2021-08-03T13:14:51.885 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:51.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:51.881233+0000) 2021-08-03T13:14:52.069 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:52.064+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.064729+0000) 2021-08-03T13:14:52.231 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:52.226+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.227620+0000) 2021-08-03T13:14:52.257 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:52.236+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10383 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:52.280 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:52.275+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.276012+0000) 2021-08-03T13:14:52.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:52.574+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.574914+0000) 2021-08-03T13:14:52.740 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:52.735+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.736087+0000) 2021-08-03T13:14:52.763 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:52.758+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.759058+0000) 2021-08-03T13:14:52.885 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:52.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.881389+0000) 2021-08-03T13:14:52.975 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:52.969+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:52.969876+0000) 2021-08-03T13:14:53.071 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:53.064+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:53.065682+0000) 2021-08-03T13:14:53.281 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:53.275+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:53.276603+0000) 2021-08-03T13:14:53.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:53.574+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:53.575042+0000) 2021-08-03T13:14:53.742 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:53.737+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:53.738652+0000) 2021-08-03T13:14:53.764 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:53.759+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:53.760006+0000) 2021-08-03T13:14:53.885 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:53.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:53.881559+0000) 2021-08-03T13:14:54.073 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:54.065+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:54.066640+0000) 2021-08-03T13:14:54.281 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:54.276+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:54.277233+0000) 2021-08-03T13:14:54.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:54.574+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:54.575183+0000) 2021-08-03T13:14:54.746 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:54.741+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:54.742139+0000) 2021-08-03T13:14:54.765 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:54.760+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:54.761017+0000) 2021-08-03T13:14:54.885 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:54.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:54.881712+0000) 2021-08-03T13:14:55.072 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:55.066+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:55.067589+0000) 2021-08-03T13:14:55.282 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:55.277+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:55.277831+0000) 2021-08-03T13:14:55.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:55.574+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:55.575313+0000) 2021-08-03T13:14:55.749 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:55.744+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:55.745708+0000) 2021-08-03T13:14:55.766 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:55.760+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:55.761611+0000) 2021-08-03T13:14:55.885 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:55.881+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:55.881879+0000) 2021-08-03T13:14:55.886 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:55.880+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:55.881219+0000) 2021-08-03T13:14:56.073 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:56.067+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:56.068511+0000) 2021-08-03T13:14:56.283 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:56.277+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:56.278430+0000) 2021-08-03T13:14:56.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:56.574+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:56.575431+0000) 2021-08-03T13:14:56.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:56.745+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:56.746105+0000) 2021-08-03T13:14:56.767 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:56.761+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:56.762184+0000) 2021-08-03T13:14:56.871 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:14:56.833+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10183 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:14:56.885 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:56.881+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:56.882020+0000) 2021-08-03T13:14:57.074 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:57.068+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:57.069458+0000) 2021-08-03T13:14:57.283 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:57.278+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:57.278967+0000) 2021-08-03T13:14:57.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:57.574+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:57.575566+0000) 2021-08-03T13:14:57.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:57.745+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:57.746260+0000) 2021-08-03T13:14:57.767 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:57.761+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:57.762771+0000) 2021-08-03T13:14:57.886 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:57.881+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:57.882175+0000) 2021-08-03T13:14:57.985 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:14:57.979+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:57.980504+0000) 2021-08-03T13:14:58.075 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:58.069+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:58.070632+0000) 2021-08-03T13:14:58.277 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:14:58.271+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:58.272169+0000) 2021-08-03T13:14:58.284 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:58.278+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:58.279546+0000) 2021-08-03T13:14:58.579 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:58.574+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:58.575684+0000) 2021-08-03T13:14:58.651 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:14:58.645+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4367 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:14:58.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:58.745+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:58.746460+0000) 2021-08-03T13:14:58.768 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:58.762+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:58.763418+0000) 2021-08-03T13:14:58.886 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:58.881+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:58.882332+0000) 2021-08-03T13:14:58.923 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:14:58.870+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10387 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:14:59.056 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:59.051+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.052584+0000) 2021-08-03T13:14:59.079 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:14:59.070+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.071610+0000) 2021-08-03T13:14:59.088 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:14:59.081+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.082670+0000) 2021-08-03T13:14:59.285 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:14:59.279+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.280484+0000) 2021-08-03T13:14:59.598 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:14:59.591+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.592053+0000) 2021-08-03T13:14:59.750 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:14:59.745+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.746598+0000) 2021-08-03T13:14:59.769 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:14:59.762+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.764057+0000) 2021-08-03T13:14:59.886 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:14:59.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:14:59.882489+0000) 2021-08-03T13:15:00.054 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:00.049+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:00.050156+0000) 2021-08-03T13:15:00.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:00.746+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:00.746845+0000) 2021-08-03T13:15:00.769 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:00.763+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:00.764922+0000) 2021-08-03T13:15:00.886 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:00.880+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:00.882649+0000) 2021-08-03T13:15:01.601 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:01.595+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:01.596689+0000) 2021-08-03T13:15:01.686 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:01.679+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:01.680118+0000) 2021-08-03T13:15:01.771 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:01.764+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:01.765809+0000) 2021-08-03T13:15:01.972 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:01.965+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:01.967112+0000) 2021-08-03T13:15:02.078 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:02.070+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:02.072240+0000) 2021-08-03T13:15:02.318 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:02.312+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:02.314311+0000) 2021-08-03T13:15:02.771 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:02.764+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:02.766637+0000) 2021-08-03T13:15:03.144 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:03.139+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:03.139987+0000) 2021-08-03T13:15:03.333 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:03.325+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:03.327525+0000) 2021-08-03T13:15:03.772 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:03.765+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:03.767459+0000) 2021-08-03T13:15:04.024 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:03.922+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10205 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:04.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:04.179+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:04.179803+0000) 2021-08-03T13:15:04.549 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:04.463+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10402 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:05.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:05.178+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:05.179964+0000) 2021-08-03T13:15:05.388 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:05.380+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:05.382643+0000) 2021-08-03T13:15:05.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:05.871+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:05.872984+0000) 2021-08-03T13:15:05.887 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:05.880+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:05.882016+0000) 2021-08-03T13:15:06.125 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:06.119+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:06.121223+0000) 2021-08-03T13:15:06.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:06.178+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:06.180130+0000) 2021-08-03T13:15:07.035 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:07.028+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:07.029959+0000) 2021-08-03T13:15:07.098 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:07.091+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:07.093165+0000) 2021-08-03T13:15:07.126 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:07.119+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:07.121788+0000) 2021-08-03T13:15:07.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:07.178+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:07.180289+0000) 2021-08-03T13:15:07.228 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:07.220+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:07.222345+0000) 2021-08-03T13:15:07.432 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:07.427+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:07.429002+0000) 2021-08-03T13:15:08.025 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:15:07.924+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4367 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:15:08.127 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:08.121+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:08.122402+0000) 2021-08-03T13:15:08.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:08.178+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:08.180401+0000) 2021-08-03T13:15:08.450 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:08.445+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:08.446256+0000) 2021-08-03T13:15:08.507 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:08.499+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:08.501532+0000) 2021-08-03T13:15:09.128 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:09.122+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:09.123620+0000) 2021-08-03T13:15:09.167 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:09.160+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:09.162067+0000) 2021-08-03T13:15:09.184 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:09.178+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:09.180559+0000) 2021-08-03T13:15:09.957 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:09.914+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10410 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:10.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:10.178+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:10.180718+0000) 2021-08-03T13:15:10.710 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:10.604+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10211 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:10.795 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:10.788+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:10.789401+0000) 2021-08-03T13:15:11.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:11.179+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:11.180860+0000) 2021-08-03T13:15:11.722 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:11.716+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:11.718030+0000) 2021-08-03T13:15:11.950 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:11.943+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:11.945414+0000) 2021-08-03T13:15:12.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:12.179+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:12.180976+0000) 2021-08-03T13:15:12.951 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:12.944+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:12.946127+0000) 2021-08-03T13:15:13.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:13.179+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:13.181143+0000) 2021-08-03T13:15:13.703 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:13.696+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:13.697767+0000) 2021-08-03T13:15:13.952 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:13.945+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:13.946856+0000) 2021-08-03T13:15:14.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:14.180+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:14.181273+0000) 2021-08-03T13:15:14.952 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:14.946+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:14.947682+0000) 2021-08-03T13:15:15.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:15.180+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:15.181435+0000) 2021-08-03T13:15:15.299 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:15.292+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:15.293562+0000) 2021-08-03T13:15:15.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:15.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:15.451169+0000) 2021-08-03T13:15:15.583 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:15.331+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10413 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:15.701 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:15.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:15.698131+0000) 2021-08-03T13:15:15.953 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:15.947+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:15.948326+0000) 2021-08-03T13:15:16.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:16.180+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:16.181546+0000) 2021-08-03T13:15:16.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:16.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:16.451299+0000) 2021-08-03T13:15:16.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:16.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:16.698281+0000) 2021-08-03T13:15:16.889 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:16.883+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:16.884642+0000) 2021-08-03T13:15:16.954 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:16.948+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:16.949447+0000) 2021-08-03T13:15:16.974 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:15:16.953+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4367 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:15:17.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:17.180+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:17.181684+0000) 2021-08-03T13:15:17.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:17.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:17.451427+0000) 2021-08-03T13:15:17.471 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:17.465+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:17.466029+0000) 2021-08-03T13:15:17.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:17.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:17.698504+0000) 2021-08-03T13:15:17.890 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:17.884+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:17.885283+0000) 2021-08-03T13:15:17.955 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:17.949+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:17.950375+0000) 2021-08-03T13:15:18.008 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:18.000+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:18.001466+0000) 2021-08-03T13:15:18.185 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:18.181+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:18.181817+0000) 2021-08-03T13:15:18.231 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:18.191+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10227 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:18.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:18.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:18.451559+0000) 2021-08-03T13:15:18.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:18.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:18.698645+0000) 2021-08-03T13:15:18.891 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:18.885+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:18.885839+0000) 2021-08-03T13:15:18.955 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:18.950+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:18.950969+0000) 2021-08-03T13:15:19.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:19.181+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:19.181962+0000) 2021-08-03T13:15:19.230 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:19.225+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:19.226806+0000) 2021-08-03T13:15:19.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:19.450+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:19.451689+0000) 2021-08-03T13:15:19.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:19.697+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:19.698800+0000) 2021-08-03T13:15:19.891 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:19.885+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:19.886550+0000) 2021-08-03T13:15:19.920 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:19.914+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:19.914857+0000) 2021-08-03T13:15:19.956 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:19.950+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:19.951585+0000) 2021-08-03T13:15:20.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:20.181+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:20.182128+0000) 2021-08-03T13:15:20.203 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:20.197+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:20.198311+0000) 2021-08-03T13:15:20.290 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:20.285+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:20.285874+0000) 2021-08-03T13:15:20.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:20.451+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:20.451837+0000) 2021-08-03T13:15:20.556 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:20.378+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10413 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:20.702 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:20.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:20.698948+0000) 2021-08-03T13:15:20.892 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:20.886+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:20.887126+0000) 2021-08-03T13:15:20.957 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:20.951+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:20.952305+0000) 2021-08-03T13:15:21.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:21.181+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:21.182264+0000) 2021-08-03T13:15:21.291 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:21.286+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:21.286942+0000) 2021-08-03T13:15:21.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:21.403+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:21.404387+0000) 2021-08-03T13:15:21.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:21.451+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:21.451961+0000) 2021-08-03T13:15:21.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:21.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:21.699091+0000) 2021-08-03T13:15:21.892 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:21.886+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:21.887655+0000) 2021-08-03T13:15:21.958 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:21.952+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:21.952925+0000) 2021-08-03T13:15:22.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:22.181+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.182382+0000) 2021-08-03T13:15:22.293 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:22.287+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.288396+0000) 2021-08-03T13:15:22.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:22.403+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.404526+0000) 2021-08-03T13:15:22.456 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:22.451+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.452091+0000) 2021-08-03T13:15:22.465 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:22.459+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.459830+0000) 2021-08-03T13:15:22.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:22.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.699228+0000) 2021-08-03T13:15:22.893 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:22.887+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.888187+0000) 2021-08-03T13:15:22.958 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:22.953+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:22.953917+0000) 2021-08-03T13:15:23.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:23.181+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:23.182533+0000) 2021-08-03T13:15:23.294 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:23.288+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:23.289530+0000) 2021-08-03T13:15:23.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:23.403+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:23.404662+0000) 2021-08-03T13:15:23.456 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:23.451+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:23.452240+0000) 2021-08-03T13:15:23.502 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:15:23.417+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4369 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:15:23.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:23.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:23.699361+0000) 2021-08-03T13:15:23.893 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:23.887+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:23.888730+0000) 2021-08-03T13:15:23.959 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:23.953+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:23.954677+0000) 2021-08-03T13:15:24.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:24.181+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:24.182686+0000) 2021-08-03T13:15:24.295 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:24.290+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:24.290892+0000) 2021-08-03T13:15:24.408 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:24.404+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:24.404818+0000) 2021-08-03T13:15:24.456 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:24.451+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:24.452372+0000) 2021-08-03T13:15:24.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:24.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:24.699515+0000) 2021-08-03T13:15:24.894 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:24.888+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:24.889323+0000) 2021-08-03T13:15:24.960 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:24.954+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:24.955430+0000) 2021-08-03T13:15:25.186 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:25.182+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:25.182861+0000) 2021-08-03T13:15:25.297 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:25.291+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:25.292281+0000) 2021-08-03T13:15:25.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:25.404+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:25.404970+0000) 2021-08-03T13:15:25.426 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:25.166+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10235 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:25.456 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:25.451+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:25.452522+0000) 2021-08-03T13:15:25.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:25.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:25.699653+0000) 2021-08-03T13:15:25.894 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:25.889+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:25.889869+0000) 2021-08-03T13:15:25.961 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:25.955+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:25.956232+0000) 2021-08-03T13:15:26.184 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:26.162+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10415 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:26.187 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:26.182+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:26.182986+0000) 2021-08-03T13:15:26.230 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:26.223+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:26.224143+0000) 2021-08-03T13:15:26.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:26.404+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:26.405088+0000) 2021-08-03T13:15:26.703 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:26.698+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:26.699801+0000) 2021-08-03T13:15:26.962 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:26.956+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:26.957039+0000) 2021-08-03T13:15:27.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:27.404+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:27.405235+0000) 2021-08-03T13:15:27.562 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:27.555+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:27.556203+0000) 2021-08-03T13:15:27.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:27.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:27.699938+0000) 2021-08-03T13:15:27.963 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:27.956+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:27.957660+0000) 2021-08-03T13:15:28.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:28.404+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:28.405392+0000) 2021-08-03T13:15:28.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:28.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:28.700070+0000) 2021-08-03T13:15:28.963 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:28.957+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:28.958498+0000) 2021-08-03T13:15:29.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:29.404+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:29.405520+0000) 2021-08-03T13:15:29.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:29.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:29.700217+0000) 2021-08-03T13:15:29.960 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:29.953+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:29.954308+0000) 2021-08-03T13:15:29.964 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:29.958+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:29.959138+0000) 2021-08-03T13:15:30.126 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:30.119+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:30.120384+0000) 2021-08-03T13:15:30.171 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:30.166+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:30.166226+0000) 2021-08-03T13:15:30.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:30.404+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:30.405667+0000) 2021-08-03T13:15:30.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:30.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:30.700350+0000) 2021-08-03T13:15:30.965 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:30.959+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:30.959915+0000) 2021-08-03T13:15:31.151 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:31.145+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.146149+0000) 2021-08-03T13:15:31.173 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:31.168+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.168731+0000) 2021-08-03T13:15:31.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:31.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.405793+0000) 2021-08-03T13:15:31.614 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:31.608+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.608835+0000) 2021-08-03T13:15:31.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:31.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.700491+0000) 2021-08-03T13:15:31.746 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:31.740+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.740811+0000) 2021-08-03T13:15:31.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:31.746+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.747267+0000) 2021-08-03T13:15:31.903 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:31.899+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.899895+0000) 2021-08-03T13:15:31.965 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:31.959+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:31.960710+0000) 2021-08-03T13:15:32.152 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:32.146+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.146857+0000) 2021-08-03T13:15:32.174 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:32.169+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.169731+0000) 2021-08-03T13:15:32.205 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:32.199+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.199774+0000) 2021-08-03T13:15:32.354 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:15:32.175+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4380 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:15:32.409 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:32.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.405915+0000) 2021-08-03T13:15:32.425 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:32.420+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.421683+0000) 2021-08-03T13:15:32.550 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:32.416+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10242 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:32.654 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:32.649+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.649901+0000) 2021-08-03T13:15:32.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:32.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.700630+0000) 2021-08-03T13:15:32.966 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:32.960+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:32.961467+0000) 2021-08-03T13:15:33.152 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:33.146+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:33.147531+0000) 2021-08-03T13:15:33.175 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:33.169+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:33.170663+0000) 2021-08-03T13:15:33.207 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:33.202+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:33.202906+0000) 2021-08-03T13:15:33.272 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:32.961+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10417 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:33.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:33.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:33.406041+0000) 2021-08-03T13:15:33.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:33.699+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:33.700779+0000) 2021-08-03T13:15:33.967 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:33.961+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:33.962099+0000) 2021-08-03T13:15:34.153 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:34.147+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:34.148386+0000) 2021-08-03T13:15:34.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:34.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:34.406162+0000) 2021-08-03T13:15:34.704 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:34.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:34.700934+0000) 2021-08-03T13:15:34.967 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:34.962+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:34.962727+0000) 2021-08-03T13:15:35.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:35.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:35.406293+0000) 2021-08-03T13:15:35.705 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:35.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:35.701061+0000) 2021-08-03T13:15:35.968 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:35.962+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:35.963572+0000) 2021-08-03T13:15:36.387 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:36.381+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:36.382005+0000) 2021-08-03T13:15:36.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:36.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:36.406420+0000) 2021-08-03T13:15:36.705 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:36.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:36.701223+0000) 2021-08-03T13:15:36.969 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:36.963+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:36.964377+0000) 2021-08-03T13:15:37.222 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:37.215+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:37.216743+0000) 2021-08-03T13:15:37.306 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:37.299+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:37.300371+0000) 2021-08-03T13:15:37.312 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:37.307+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:37.308451+0000) 2021-08-03T13:15:37.410 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:37.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:37.406567+0000) 2021-08-03T13:15:37.634 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:37.627+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:37.628395+0000) 2021-08-03T13:15:37.705 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:37.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:37.701366+0000) 2021-08-03T13:15:37.969 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:37.964+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:37.964949+0000) 2021-08-03T13:15:38.024 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:38.020+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:38.020825+0000) 2021-08-03T13:15:38.312 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:38.307+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:38.308613+0000) 2021-08-03T13:15:38.683 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:38.677+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:38.678251+0000) 2021-08-03T13:15:38.705 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:38.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:38.701522+0000) 2021-08-03T13:15:38.846 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:38.839+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:38.840149+0000) 2021-08-03T13:15:38.970 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:38.964+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:38.965568+0000) 2021-08-03T13:15:39.037 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:38.816+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10259 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:39.183 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:39.167+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:39.410 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:15:39.271+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4382 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:15:39.705 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:39.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:39.701653+0000) 2021-08-03T13:15:39.814 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:39.809+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:39.810098+0000) 2021-08-03T13:15:39.971 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:39.965+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:39.966234+0000) 2021-08-03T13:15:40.229 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:40.224+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:40.225392+0000) 2021-08-03T13:15:40.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:40.700+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:40.701792+0000) 2021-08-03T13:15:40.777 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:40.771+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:40.772029+0000) 2021-08-03T13:15:40.964 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:40.959+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:40.960176+0000) 2021-08-03T13:15:41.131 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:41.124+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:41.125471+0000) 2021-08-03T13:15:41.707 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:41.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:41.701922+0000) 2021-08-03T13:15:41.958 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:41.951+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:41.952383+0000) 2021-08-03T13:15:42.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:42.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:42.702061+0000) 2021-08-03T13:15:42.832 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:42.826+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:42.827065+0000) 2021-08-03T13:15:43.199 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:43.192+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:43.193640+0000) 2021-08-03T13:15:43.581 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:43.576+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:43.577123+0000) 2021-08-03T13:15:43.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:43.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:43.702192+0000) 2021-08-03T13:15:44.332 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:44.327+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:44.328327+0000) 2021-08-03T13:15:44.392 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:44.383+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10262 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:44.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:44.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:44.702348+0000) 2021-08-03T13:15:45.241 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:45.234+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:45.235786+0000) 2021-08-03T13:15:45.706 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:45.701+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:45.702484+0000) 2021-08-03T13:15:45.741 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:45.735+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:45.736089+0000) 2021-08-03T13:15:45.772 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:45.726+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:46.222 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:46.216+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:46.216915+0000) 2021-08-03T13:15:46.898 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:46.892+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:46.893221+0000) 2021-08-03T13:15:47.006 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:47.000+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:47.001753+0000) 2021-08-03T13:15:47.183 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:47.178+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:47.178855+0000) 2021-08-03T13:15:47.485 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:47.479+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:47.479980+0000) 2021-08-03T13:15:47.795 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:47.789+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:47.790658+0000) 2021-08-03T13:15:47.898 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:47.893+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:47.893937+0000) 2021-08-03T13:15:48.007 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:48.001+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:48.002758+0000) 2021-08-03T13:15:48.111 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:48.105+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:48.106163+0000) 2021-08-03T13:15:48.256 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:48.251+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:48.251954+0000) 2021-08-03T13:15:48.680 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:15:48.672+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4385 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:15:48.899 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:48.893+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:48.894533+0000) 2021-08-03T13:15:49.008 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:49.002+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:49.003408+0000) 2021-08-03T13:15:49.204 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:49.198+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:49.199109+0000) 2021-08-03T13:15:49.218 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:49.213+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:49.214251+0000) 2021-08-03T13:15:49.438 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:49.433+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:49.434002+0000) 2021-08-03T13:15:49.804 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:49.797+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:49.798526+0000) 2021-08-03T13:15:49.900 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:49.894+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:49.895135+0000) 2021-08-03T13:15:50.008 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:50.003+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:50.004251+0000) 2021-08-03T13:15:50.206 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:50.201+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:50.202754+0000) 2021-08-03T13:15:50.348 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:50.343+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:50.343954+0000) 2021-08-03T13:15:50.438 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:50.433+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:50.434195+0000) 2021-08-03T13:15:50.822 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:50.716+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10267 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:51.010 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:51.004+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:51.005404+0000) 2021-08-03T13:15:51.098 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:51.091+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:51.092746+0000) 2021-08-03T13:15:51.224 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:51.219+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:51.220125+0000) 2021-08-03T13:15:51.349 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:51.343+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:51.344479+0000) 2021-08-03T13:15:52.010 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:52.005+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:52.006000+0000) 2021-08-03T13:15:52.225 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:52.219+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:52.220720+0000) 2021-08-03T13:15:52.349 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:52.344+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:52.345058+0000) 2021-08-03T13:15:53.004 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:52.718+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:53.013 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:53.006+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:53.006893+0000) 2021-08-03T13:15:53.023 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:53.018+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:53.019586+0000) 2021-08-03T13:15:53.226 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:53.220+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:53.221659+0000) 2021-08-03T13:15:53.350 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:53.344+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:53.345607+0000) 2021-08-03T13:15:54.012 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:54.006+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:54.007604+0000) 2021-08-03T13:15:54.179 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:54.173+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:54.173942+0000) 2021-08-03T13:15:54.227 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:54.221+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:54.222497+0000) 2021-08-03T13:15:54.310 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:54.305+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:54.305876+0000) 2021-08-03T13:15:54.351 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:54.345+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:54.346192+0000) 2021-08-03T13:15:54.506 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:15:54.501+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4387 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:15:54.694 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:15:54.686+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:54.687215+0000) 2021-08-03T13:15:55.012 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:55.007+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:55.008191+0000) 2021-08-03T13:15:55.179 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:55.173+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:55.174600+0000) 2021-08-03T13:15:55.227 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:55.222+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:55.223090+0000) 2021-08-03T13:15:55.311 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:55.305+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:55.306564+0000) 2021-08-03T13:15:55.351 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:55.346+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:55.346761+0000) 2021-08-03T13:15:55.457 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:55.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:55.453678+0000) 2021-08-03T13:15:56.013 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:56.008+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.008800+0000) 2021-08-03T13:15:56.180 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:56.173+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.175182+0000) 2021-08-03T13:15:56.228 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:56.222+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.223669+0000) 2021-08-03T13:15:56.286 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:56.281+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.282375+0000) 2021-08-03T13:15:56.312 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:56.305+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.307492+0000) 2021-08-03T13:15:56.352 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:56.345+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.347369+0000) 2021-08-03T13:15:56.457 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:56.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.453811+0000) 2021-08-03T13:15:56.540 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:15:56.532+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:56.534542+0000) 2021-08-03T13:15:57.014 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:57.008+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.009778+0000) 2021-08-03T13:15:57.180 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:57.174+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.175773+0000) 2021-08-03T13:15:57.229 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:57.223+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.224237+0000) 2021-08-03T13:15:57.289 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:15:57.282+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.283661+0000) 2021-08-03T13:15:57.312 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:57.306+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.308044+0000) 2021-08-03T13:15:57.352 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:57.346+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.347937+0000) 2021-08-03T13:15:57.457 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:57.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.453981+0000) 2021-08-03T13:15:57.957 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:15:57.952+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:57.953145+0000) 2021-08-03T13:15:58.015 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:58.009+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:58.010545+0000) 2021-08-03T13:15:58.181 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:58.174+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:58.176345+0000) 2021-08-03T13:15:58.229 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:15:58.224+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:58.224841+0000) 2021-08-03T13:15:58.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:58.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:58.406968+0000) 2021-08-03T13:15:58.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:58.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:58.454108+0000) 2021-08-03T13:15:58.623 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:15:58.490+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10290 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:15:58.698 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:15:58.683+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:15:59.016 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:15:59.010+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:59.011186+0000) 2021-08-03T13:15:59.181 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:15:59.175+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:59.177122+0000) 2021-08-03T13:15:59.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:59.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:59.407104+0000) 2021-08-03T13:15:59.422 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:15:59.415+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:59.417039+0000) 2021-08-03T13:15:59.429 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:15:59.422+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:59.423807+0000) 2021-08-03T13:15:59.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:15:59.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:15:59.454251+0000) 2021-08-03T13:16:00.016 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:00.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:00.011780+0000) 2021-08-03T13:16:00.049 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:16:00.043+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:00.044466+0000) 2021-08-03T13:16:00.182 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:00.175+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:00.177702+0000) 2021-08-03T13:16:00.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:00.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:00.407238+0000) 2021-08-03T13:16:00.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:00.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:00.454357+0000) 2021-08-03T13:16:01.017 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:01.011+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.012617+0000) 2021-08-03T13:16:01.021 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:01.015+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.017143+0000) 2021-08-03T13:16:01.183 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:01.176+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.178346+0000) 2021-08-03T13:16:01.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:01.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.407353+0000) 2021-08-03T13:16:01.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:01.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.454492+0000) 2021-08-03T13:16:01.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:01.557+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.559597+0000) 2021-08-03T13:16:01.751 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:01.745+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.747519+0000) 2021-08-03T13:16:01.973 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:01.966+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:01.967582+0000) 2021-08-03T13:16:01.976 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:01.967+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4387 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:02.017 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:02.012+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:02.013453+0000) 2021-08-03T13:16:02.184 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:02.177+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:02.179166+0000) 2021-08-03T13:16:02.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:02.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:02.407502+0000) 2021-08-03T13:16:02.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:02.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:02.454622+0000) 2021-08-03T13:16:02.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:02.557+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:02.559702+0000) 2021-08-03T13:16:02.754 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:02.748+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:02.749903+0000) 2021-08-03T13:16:03.018 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:03.013+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:03.014066+0000) 2021-08-03T13:16:03.139 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:03.132+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:03.133391+0000) 2021-08-03T13:16:03.184 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:03.178+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:03.179862+0000) 2021-08-03T13:16:03.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:03.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:03.407623+0000) 2021-08-03T13:16:03.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:03.452+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:03.454741+0000) 2021-08-03T13:16:03.563 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:03.558+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:03.559840+0000) 2021-08-03T13:16:03.756 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:03.750+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:03.752466+0000) 2021-08-03T13:16:04.019 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:04.013+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:04.014669+0000) 2021-08-03T13:16:04.186 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:04.179+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:04.180872+0000) 2021-08-03T13:16:04.411 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:04.405+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:04.407798+0000) 2021-08-03T13:16:04.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:04.453+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:04.454843+0000) 2021-08-03T13:16:04.564 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:04.558+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:04.559999+0000) 2021-08-03T13:16:04.718 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:04.710+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:04.712520+0000) 2021-08-03T13:16:04.760 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:04.755+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:04.756901+0000) 2021-08-03T13:16:04.922 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:04.863+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10299 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:05.020 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:05.014+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:05.015748+0000) 2021-08-03T13:16:05.186 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:05.180+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:05.181612+0000) 2021-08-03T13:16:05.242 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:16:05.003+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:16:05.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:05.407+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:05.407950+0000) 2021-08-03T13:16:05.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:05.454+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:05.454950+0000) 2021-08-03T13:16:05.761 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:05.756+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:05.757411+0000) 2021-08-03T13:16:06.021 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:06.015+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:06.016374+0000) 2021-08-03T13:16:06.187 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:06.181+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:06.182238+0000) 2021-08-03T13:16:06.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:06.407+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:06.408096+0000) 2021-08-03T13:16:06.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:06.454+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:06.455099+0000) 2021-08-03T13:16:06.727 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:06.720+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:06.721665+0000) 2021-08-03T13:16:06.761 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:06.756+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:06.757652+0000) 2021-08-03T13:16:06.943 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:16:06.936+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:06.937544+0000) 2021-08-03T13:16:07.022 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:07.016+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.017264+0000) 2021-08-03T13:16:07.080 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:07.076+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.076958+0000) 2021-08-03T13:16:07.099 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:07.094+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.095208+0000) 2021-08-03T13:16:07.187 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:07.182+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.182848+0000) 2021-08-03T13:16:07.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:07.407+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.408237+0000) 2021-08-03T13:16:07.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:07.454+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.455229+0000) 2021-08-03T13:16:07.761 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:07.757+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.757791+0000) 2021-08-03T13:16:07.813 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:07.807+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.808427+0000) 2021-08-03T13:16:07.934 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:07.928+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:07.929107+0000) 2021-08-03T13:16:08.023 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:08.017+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:08.018629+0000) 2021-08-03T13:16:08.188 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:08.182+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:08.183496+0000) 2021-08-03T13:16:08.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:08.407+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:08.408391+0000) 2021-08-03T13:16:08.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:08.454+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:08.455371+0000) 2021-08-03T13:16:08.762 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:08.757+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:08.758029+0000) 2021-08-03T13:16:09.024 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:09.018+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:09.019520+0000) 2021-08-03T13:16:09.189 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:09.183+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:09.184113+0000) 2021-08-03T13:16:09.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:09.407+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:09.408542+0000) 2021-08-03T13:16:09.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:09.454+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:09.455491+0000) 2021-08-03T13:16:09.762 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:09.757+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:09.758173+0000) 2021-08-03T13:16:10.025 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:10.019+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:10.020351+0000) 2021-08-03T13:16:10.139 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:10.133+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:10.134278+0000) 2021-08-03T13:16:10.189 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:10.184+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:10.184732+0000) 2021-08-03T13:16:10.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:10.407+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:10.408686+0000) 2021-08-03T13:16:10.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:10.454+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:10.455618+0000) 2021-08-03T13:16:10.762 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:10.757+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:10.758389+0000) 2021-08-03T13:16:10.903 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:10.898+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:10.898760+0000) 2021-08-03T13:16:11.025 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:11.020+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.020963+0000) 2021-08-03T13:16:11.139 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:11.134+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.134961+0000) 2021-08-03T13:16:11.190 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:11.184+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.185355+0000) 2021-08-03T13:16:11.412 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:11.408+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.408839+0000) 2021-08-03T13:16:11.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:11.454+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.455733+0000) 2021-08-03T13:16:11.653 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:11.647+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.647956+0000) 2021-08-03T13:16:11.762 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:11.757+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.758526+0000) 2021-08-03T13:16:11.904 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:11.898+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:11.899473+0000) 2021-08-03T13:16:12.026 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:12.020+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.021778+0000) 2021-08-03T13:16:12.140 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:12.134+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.135688+0000) 2021-08-03T13:16:12.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:12.185+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.185932+0000) 2021-08-03T13:16:12.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:12.408+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.408967+0000) 2021-08-03T13:16:12.460 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:12.455+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.455861+0000) 2021-08-03T13:16:12.653 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:12.647+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.648621+0000) 2021-08-03T13:16:12.695 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:12.689+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4387 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:12.762 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:12.757+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.758751+0000) 2021-08-03T13:16:12.904 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:12.899+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:12.899933+0000) 2021-08-03T13:16:13.026 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:13.021+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.022391+0000) 2021-08-03T13:16:13.191 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:13.185+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.186499+0000) 2021-08-03T13:16:13.305 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:16:13.104+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:16:13.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:13.408+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.409100+0000) 2021-08-03T13:16:13.460 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:13.455+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.456023+0000) 2021-08-03T13:16:13.547 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:13.541+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.541824+0000) 2021-08-03T13:16:13.653 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:13.648+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.649189+0000) 2021-08-03T13:16:13.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:13.758+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.758881+0000) 2021-08-03T13:16:13.878 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:13.761+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10319 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:13.905 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:13.900+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.900778+0000) 2021-08-03T13:16:13.943 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:13.936+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:13.938111+0000) 2021-08-03T13:16:14.027 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:14.021+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:14.022986+0000) 2021-08-03T13:16:14.192 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:14.186+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:14.187098+0000) 2021-08-03T13:16:14.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:14.408+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:14.409262+0000) 2021-08-03T13:16:14.460 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:14.455+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:14.456131+0000) 2021-08-03T13:16:14.547 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:14.541+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:14.542505+0000) 2021-08-03T13:16:14.649 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:14.644+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:14.646161+0000) 2021-08-03T13:16:14.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:14.758+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:14.759113+0000) 2021-08-03T13:16:15.028 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:15.022+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.023818+0000) 2021-08-03T13:16:15.192 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:15.187+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.187789+0000) 2021-08-03T13:16:15.204 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:15.197+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.199068+0000) 2021-08-03T13:16:15.301 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:15.296+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.297115+0000) 2021-08-03T13:16:15.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:15.408+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.409383+0000) 2021-08-03T13:16:15.460 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:15.455+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.456249+0000) 2021-08-03T13:16:15.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:15.684+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.685350+0000) 2021-08-03T13:16:15.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:15.758+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.759232+0000) 2021-08-03T13:16:15.797 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:15.791+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.791970+0000) 2021-08-03T13:16:15.832 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:15.827+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:15.828957+0000) 2021-08-03T13:16:16.029 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:16.022+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:16.024426+0000) 2021-08-03T13:16:16.193 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:16.187+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:16.188428+0000) 2021-08-03T13:16:16.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:16.408+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:16.409516+0000) 2021-08-03T13:16:16.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:16.684+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:16.685515+0000) 2021-08-03T13:16:16.736 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:16.730+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:16.731356+0000) 2021-08-03T13:16:16.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:16.758+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:16.759430+0000) 2021-08-03T13:16:16.832 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:16.827+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:16.829107+0000) 2021-08-03T13:16:17.031 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:17.023+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.025085+0000) 2021-08-03T13:16:17.044 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:16:17.036+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.038629+0000) 2021-08-03T13:16:17.193 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:17.188+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.189035+0000) 2021-08-03T13:16:17.413 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:17.408+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.409660+0000) 2021-08-03T13:16:17.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:17.684+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.685642+0000) 2021-08-03T13:16:17.763 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:17.758+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.759568+0000) 2021-08-03T13:16:17.833 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:17.827+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.829247+0000) 2021-08-03T13:16:17.920 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:17.915+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:17.916497+0000) 2021-08-03T13:16:18.194 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:18.188+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:18.189598+0000) 2021-08-03T13:16:18.269 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:18.263+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:18.264623+0000) 2021-08-03T13:16:18.414 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:18.409+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:18.409824+0000) 2021-08-03T13:16:18.500 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:18.493+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:18.495046+0000) 2021-08-03T13:16:18.689 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:18.684+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:18.685797+0000) 2021-08-03T13:16:18.764 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:18.758+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:18.759788+0000) 2021-08-03T13:16:18.833 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:18.827+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:18.829376+0000) 2021-08-03T13:16:19.195 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:19.189+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:19.190383+0000) 2021-08-03T13:16:19.241 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:19.236+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:19.237456+0000) 2021-08-03T13:16:19.683 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:19.232+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10351 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:19.764 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:19.759+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:19.759948+0000) 2021-08-03T13:16:19.833 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:19.827+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:19.829522+0000) 2021-08-03T13:16:19.887 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:19.674+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4387 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:19.960 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:19.955+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:19.956471+0000) 2021-08-03T13:16:20.196 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:20.190+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:20.191056+0000) 2021-08-03T13:16:20.764 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:20.759+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:20.760169+0000) 2021-08-03T13:16:20.833 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:20.827+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:20.829678+0000) 2021-08-03T13:16:20.960 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:20.955+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:20.956615+0000) 2021-08-03T13:16:21.196 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:21.190+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:21.191604+0000) 2021-08-03T13:16:21.764 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:21.759+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:21.760309+0000) 2021-08-03T13:16:21.833 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:21.827+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:21.829819+0000) 2021-08-03T13:16:22.197 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:22.191+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:22.192219+0000) 2021-08-03T13:16:22.606 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:22.600+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:22.600847+0000) 2021-08-03T13:16:22.958 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:22.953+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:22.953858+0000) 2021-08-03T13:16:22.975 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:16:22.968+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:16:23.197 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:23.192+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:23.192788+0000) 2021-08-03T13:16:23.839 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:23.834+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:23.835028+0000) 2021-08-03T13:16:24.200 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:24.192+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:24.193574+0000) 2021-08-03T13:16:24.291 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:24.286+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:24.287720+0000) 2021-08-03T13:16:24.358 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:24.352+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:24.353107+0000) 2021-08-03T13:16:24.609 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:24.604+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:24.604820+0000) 2021-08-03T13:16:25.319 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:25.313+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:25.314266+0000) 2021-08-03T13:16:25.518 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:25.466+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4388 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:26.418 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:26.381+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10359 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:26.459 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:26.452+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:26.453494+0000) 2021-08-03T13:16:26.505 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:26.498+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:26.499127+0000) 2021-08-03T13:16:26.936 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:26.930+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:26.930857+0000) 2021-08-03T13:16:27.303 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:27.298+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:27.298941+0000) 2021-08-03T13:16:27.866 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:27.859+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:27.860407+0000) 2021-08-03T13:16:27.994 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:27.988+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:27.988986+0000) 2021-08-03T13:16:28.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:28.706+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:28.707040+0000) 2021-08-03T13:16:28.964 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:16:28.716+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10436 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:16:28.994 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:28.988+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:28.989700+0000) 2021-08-03T13:16:29.238 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:29.232+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:29.233082+0000) 2021-08-03T13:16:29.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:29.706+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:29.707172+0000) 2021-08-03T13:16:29.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:29.810+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:29.811199+0000) 2021-08-03T13:16:29.995 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:29.989+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:29.990266+0000) 2021-08-03T13:16:30.129 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:30.123+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.124021+0000) 2021-08-03T13:16:30.238 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:30.233+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.234003+0000) 2021-08-03T13:16:30.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:30.706+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.707294+0000) 2021-08-03T13:16:30.740 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:30.735+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.736048+0000) 2021-08-03T13:16:30.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:30.810+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.811340+0000) 2021-08-03T13:16:30.828 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:30.823+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.824738+0000) 2021-08-03T13:16:30.995 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:30.990+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.991050+0000) 2021-08-03T13:16:30.998 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:30.993+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:30.994337+0000) 2021-08-03T13:16:31.129 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:31.123+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:31.124583+0000) 2021-08-03T13:16:31.239 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:31.233+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:31.234567+0000) 2021-08-03T13:16:31.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:31.706+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:31.707430+0000) 2021-08-03T13:16:31.741 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:31.735+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:31.736724+0000) 2021-08-03T13:16:31.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:31.810+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:31.811473+0000) 2021-08-03T13:16:31.996 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:31.991+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:31.991909+0000) 2021-08-03T13:16:32.130 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:32.124+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.125150+0000) 2021-08-03T13:16:32.240 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:32.234+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.235504+0000) 2021-08-03T13:16:32.468 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:32.463+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.464482+0000) 2021-08-03T13:16:32.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:32.706+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.707545+0000) 2021-08-03T13:16:32.742 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:32.736+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.737267+0000) 2021-08-03T13:16:32.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:32.810+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.811611+0000) 2021-08-03T13:16:32.852 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:32.846+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.847283+0000) 2021-08-03T13:16:32.959 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:32.954+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.955219+0000) 2021-08-03T13:16:32.997 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:32.991+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:32.992503+0000) 2021-08-03T13:16:33.130 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:33.124+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.125672+0000) 2021-08-03T13:16:33.241 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:33.235+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.236092+0000) 2021-08-03T13:16:33.711 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:33.706+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.707659+0000) 2021-08-03T13:16:33.742 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:33.737+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.737843+0000) 2021-08-03T13:16:33.815 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:33.810+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.811731+0000) 2021-08-03T13:16:33.852 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:33.847+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.848008+0000) 2021-08-03T13:16:33.959 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:33.954+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.955367+0000) 2021-08-03T13:16:33.992 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:33.985+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10369 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:33.998 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:33.992+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:33.993110+0000) 2021-08-03T13:16:34.205 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:34.198+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4392 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:34.241 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:34.236+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:34.236906+0000) 2021-08-03T13:16:34.281 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:34.275+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:34.276326+0000) 2021-08-03T13:16:34.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:34.811+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:34.811867+0000) 2021-08-03T13:16:34.959 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:34.954+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:34.955497+0000) 2021-08-03T13:16:35.098 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:35.093+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:35.093949+0000) 2021-08-03T13:16:35.242 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:35.236+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:35.237506+0000) 2021-08-03T13:16:35.816 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:35.811+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:35.811977+0000) 2021-08-03T13:16:35.959 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:35.954+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:35.955646+0000) 2021-08-03T13:16:36.072 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:36.065+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:36.066599+0000) 2021-08-03T13:16:36.100 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:36.095+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:36.096387+0000) 2021-08-03T13:16:37.103 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:37.098+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:37.098984+0000) 2021-08-03T13:16:37.350 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:37.344+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:37.345174+0000) 2021-08-03T13:16:37.737 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:37.730+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:37.731360+0000) 2021-08-03T13:16:37.753 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:37.748+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:37.749195+0000) 2021-08-03T13:16:37.759 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:16:37.352+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10440 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:16:38.078 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:38.071+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:38.072414+0000) 2021-08-03T13:16:38.105 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:38.100+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:38.101568+0000) 2021-08-03T13:16:38.758 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:38.750+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:38.751354+0000) 2021-08-03T13:16:39.099 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:39.092+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:39.093302+0000) 2021-08-03T13:16:39.106 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:39.101+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:39.102163+0000) 2021-08-03T13:16:40.106 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:40.101+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:40.102298+0000) 2021-08-03T13:16:40.173 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:40.168+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:40.169797+0000) 2021-08-03T13:16:40.436 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:40.431+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:40.432553+0000) 2021-08-03T13:16:40.891 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:40.885+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10377 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:41.163 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:41.142+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4392 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:41.462 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:41.457+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:41.457992+0000) 2021-08-03T13:16:41.926 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:41.919+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:41.920362+0000) 2021-08-03T13:16:43.060 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:43.054+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:43.055544+0000) 2021-08-03T13:16:43.138 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:43.132+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:43.132862+0000) 2021-08-03T13:16:43.954 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:43.948+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:43.949743+0000) 2021-08-03T13:16:46.312 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:16:46.304+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:46.305299+0000) 2021-08-03T13:16:46.319 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:46.314+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:46.315365+0000) 2021-08-03T13:16:46.425 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:46.418+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:46.419670+0000) 2021-08-03T13:16:46.941 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:46.935+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:46.937409+0000) 2021-08-03T13:16:47.084 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:47.080+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:47.081084+0000) 2021-08-03T13:16:47.205 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:16:47.166+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10455 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:16:47.841 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:47.835+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:47.837281+0000) 2021-08-03T13:16:47.941 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:47.935+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:47.937531+0000) 2021-08-03T13:16:48.085 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:48.080+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:48.081238+0000) 2021-08-03T13:16:48.334 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:48.327+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:48.329120+0000) 2021-08-03T13:16:48.335 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:48.329+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:48.331160+0000) 2021-08-03T13:16:48.819 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:48.813+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:48.815745+0000) 2021-08-03T13:16:48.941 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:48.935+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:48.937654+0000) 2021-08-03T13:16:49.085 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:49.080+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:49.081385+0000) 2021-08-03T13:16:49.212 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:49.206+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:49.208432+0000) 2021-08-03T13:16:49.219 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:16:49.212+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:49.212950+0000) 2021-08-03T13:16:49.279 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:49.257+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10387 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:49.336 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:49.330+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:49.331901+0000) 2021-08-03T13:16:49.769 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:16:49.763+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:49.764275+0000) 2021-08-03T13:16:50.212 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:50.206+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:50.208576+0000) 2021-08-03T13:16:50.525 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:49.835+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4392 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:50.933 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:50.927+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:50.927913+0000) 2021-08-03T13:16:51.212 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:51.206+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:51.208708+0000) 2021-08-03T13:16:52.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:52.207+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:52.208843+0000) 2021-08-03T13:16:52.534 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:52.528+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:52.530233+0000) 2021-08-03T13:16:53.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:53.207+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:53.208996+0000) 2021-08-03T13:16:53.287 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:16:53.280+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:53.281761+0000) 2021-08-03T13:16:54.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:54.207+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:54.209132+0000) 2021-08-03T13:16:54.398 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:54.392+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:54.394126+0000) 2021-08-03T13:16:54.440 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:54.434+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:54.436099+0000) 2021-08-03T13:16:54.726 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:16:54.719+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:54.721244+0000) 2021-08-03T13:16:55.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:55.207+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:55.209268+0000) 2021-08-03T13:16:55.298 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:16:55.294+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:55.294944+0000) 2021-08-03T13:16:55.299 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:55.293+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:55.294922+0000) 2021-08-03T13:16:55.442 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:55.436+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:55.438672+0000) 2021-08-03T13:16:55.657 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:16:55.650+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:55.652042+0000) 2021-08-03T13:16:56.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:56.207+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:56.209377+0000) 2021-08-03T13:16:56.239 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:16:56.232+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:56.233010+0000) 2021-08-03T13:16:56.445 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:56.440+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:56.441259+0000) 2021-08-03T13:16:57.081 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:57.075+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:57.076766+0000) 2021-08-03T13:16:57.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:57.208+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:57.209524+0000) 2021-08-03T13:16:57.343 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:16:57.074+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:16:57.449 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:57.444+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:57.445677+0000) 2021-08-03T13:16:57.626 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:16:57.620+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:57.620796+0000) 2021-08-03T13:16:58.082 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:16:58.076+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:58.077501+0000) 2021-08-03T13:16:58.083 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:16:57.939+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4395 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:16:58.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:58.208+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:58.209644+0000) 2021-08-03T13:16:58.311 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:58.306+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:58.307317+0000) 2021-08-03T13:16:58.450 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:58.445+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:58.446262+0000) 2021-08-03T13:16:58.797 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:16:58.678+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10399 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:16:59.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:59.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:59.209805+0000) 2021-08-03T13:16:59.453 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:59.447+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:59.448791+0000) 2021-08-03T13:16:59.633 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:16:59.628+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:16:59.629230+0000) 2021-08-03T13:17:00.210 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:00.205+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:00.206753+0000) 2021-08-03T13:17:00.213 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:00.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:00.209974+0000) 2021-08-03T13:17:00.455 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:00.450+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:00.451370+0000) 2021-08-03T13:17:01.210 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:01.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:01.206917+0000) 2021-08-03T13:17:01.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:01.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:01.210095+0000) 2021-08-03T13:17:01.416 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:01.409+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:01.410604+0000) 2021-08-03T13:17:01.457 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:01.453+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:01.453967+0000) 2021-08-03T13:17:01.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:01.632+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:01.632935+0000) 2021-08-03T13:17:02.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:02.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:02.207045+0000) 2021-08-03T13:17:02.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:02.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:02.210221+0000) 2021-08-03T13:17:02.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:02.453+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:02.454535+0000) 2021-08-03T13:17:02.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:02.632+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:02.633061+0000) 2021-08-03T13:17:02.888 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:02.883+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:02.884455+0000) 2021-08-03T13:17:02.915 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:02.908+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:02.909667+0000) 2021-08-03T13:17:02.919 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:02.912+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:02.913572+0000) 2021-08-03T13:17:03.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:03.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:03.207186+0000) 2021-08-03T13:17:03.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:03.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:03.210362+0000) 2021-08-03T13:17:03.368 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:03.217+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:03.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:03.453+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:03.454754+0000) 2021-08-03T13:17:03.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:03.632+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:03.633200+0000) 2021-08-03T13:17:03.676 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:03.670+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:03.671640+0000) 2021-08-03T13:17:04.144 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:04.138+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.139223+0000) 2021-08-03T13:17:04.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:04.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.207323+0000) 2021-08-03T13:17:04.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:04.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.210495+0000) 2021-08-03T13:17:04.458 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:04.454+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.454912+0000) 2021-08-03T13:17:04.495 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:04.489+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.490005+0000) 2021-08-03T13:17:04.522 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:04.515+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.516687+0000) 2021-08-03T13:17:04.584 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:04.181+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10414 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:04.677 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:04.671+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.672202+0000) 2021-08-03T13:17:04.746 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:04.740+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:04.740974+0000) 2021-08-03T13:17:05.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:05.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:05.207446+0000) 2021-08-03T13:17:05.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:05.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:05.210648+0000) 2021-08-03T13:17:05.239 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:05.235+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:05.235994+0000) 2021-08-03T13:17:05.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:05.454+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:05.455155+0000) 2021-08-03T13:17:05.677 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:05.672+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:05.672843+0000) 2021-08-03T13:17:06.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:06.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:06.207581+0000) 2021-08-03T13:17:06.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:06.209+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:06.210796+0000) 2021-08-03T13:17:06.247 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:06.242+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:06.243016+0000) 2021-08-03T13:17:06.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:06.454+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:06.455287+0000) 2021-08-03T13:17:06.486 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:06.481+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:06.482347+0000) 2021-08-03T13:17:06.678 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:06.672+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:06.673419+0000) 2021-08-03T13:17:07.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:07.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:07.207721+0000) 2021-08-03T13:17:07.214 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:07.210+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:07.210947+0000) 2021-08-03T13:17:07.248 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:07.243+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:07.244263+0000) 2021-08-03T13:17:07.459 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:07.454+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:07.455496+0000) 2021-08-03T13:17:07.679 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:07.673+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:07.674312+0000) 2021-08-03T13:17:08.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:08.206+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:08.207863+0000) 2021-08-03T13:17:08.215 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:08.210+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:08.211101+0000) 2021-08-03T13:17:08.249 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:08.244+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:08.244886+0000) 2021-08-03T13:17:08.362 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:08.082+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4395 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:08.460 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:08.454+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:08.454800+0000) 2021-08-03T13:17:08.679 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:08.674+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:08.675044+0000) 2021-08-03T13:17:08.985 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:08.974+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:09.211 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:09.207+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:09.207986+0000) 2021-08-03T13:17:09.215 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:09.210+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:09.211245+0000) 2021-08-03T13:17:09.250 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:09.245+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:09.245796+0000) 2021-08-03T13:17:09.704 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:09.699+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:09.699910+0000) 2021-08-03T13:17:09.940 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:09.934+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:09.935590+0000) 2021-08-03T13:17:10.215 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:10.210+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:10.211385+0000) 2021-08-03T13:17:10.251 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:10.245+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:10.246766+0000) 2021-08-03T13:17:10.292 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:10.264+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10428 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:10.309 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:10.303+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:10.304038+0000) 2021-08-03T13:17:10.326 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:10.320+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:10.321249+0000) 2021-08-03T13:17:11.215 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:11.210+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:11.211516+0000) 2021-08-03T13:17:11.252 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:11.246+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:11.247485+0000) 2021-08-03T13:17:12.215 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:12.210+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:12.211620+0000) 2021-08-03T13:17:12.252 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:12.247+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:12.248108+0000) 2021-08-03T13:17:12.271 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:12.266+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:12.267401+0000) 2021-08-03T13:17:12.828 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:12.823+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:12.824581+0000) 2021-08-03T13:17:13.054 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:13.049+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:13.050268+0000) 2021-08-03T13:17:13.150 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:13.144+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:13.145765+0000) 2021-08-03T13:17:13.215 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:13.211+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:13.211794+0000) 2021-08-03T13:17:13.253 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:13.247+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:13.248725+0000) 2021-08-03T13:17:13.540 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:13.359+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4395 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:14.151 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:14.145+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:14.146461+0000) 2021-08-03T13:17:14.171 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:14.165+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:14.166279+0000) 2021-08-03T13:17:14.216 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:14.211+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:14.211964+0000) 2021-08-03T13:17:14.254 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:14.248+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:14.249522+0000) 2021-08-03T13:17:14.256 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:14.249+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:14.250591+0000) 2021-08-03T13:17:14.810 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:14.803+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:14.804103+0000) 2021-08-03T13:17:15.151 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:15.146+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:15.147079+0000) 2021-08-03T13:17:15.216 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:15.211+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:15.212104+0000) 2021-08-03T13:17:15.254 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:15.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:15.250833+0000) 2021-08-03T13:17:15.425 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:15.418+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:15.418788+0000) 2021-08-03T13:17:15.706 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:15.463+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:16.152 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:16.146+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:16.147688+0000) 2021-08-03T13:17:16.216 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:16.211+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:16.212232+0000) 2021-08-03T13:17:16.254 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:16.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:16.250982+0000) 2021-08-03T13:17:16.308 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:16.302+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:16.303230+0000) 2021-08-03T13:17:16.312 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:16.307+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:16.308302+0000) 2021-08-03T13:17:16.367 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:16.361+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:16.362411+0000) 2021-08-03T13:17:16.523 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:16.516+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:16.517339+0000) 2021-08-03T13:17:17.153 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:17.148+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:17.149091+0000) 2021-08-03T13:17:17.216 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:17.211+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:17.212389+0000) 2021-08-03T13:17:17.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:17.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:17.251117+0000) 2021-08-03T13:17:17.313 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:17.308+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:17.309017+0000) 2021-08-03T13:17:17.348 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:17.343+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:17.344780+0000) 2021-08-03T13:17:17.368 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:17.362+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:17.363558+0000) 2021-08-03T13:17:17.576 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:17.472+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10445 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:18.115 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:18.110+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:18.110923+0000) 2021-08-03T13:17:18.168 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:18.162+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:18.163033+0000) 2021-08-03T13:17:18.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:18.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:18.251231+0000) 2021-08-03T13:17:18.351 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:18.346+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:18.347287+0000) 2021-08-03T13:17:18.368 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:18.363+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:18.364110+0000) 2021-08-03T13:17:18.598 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:18.591+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:18.592199+0000) 2021-08-03T13:17:19.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:19.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:19.251390+0000) 2021-08-03T13:17:19.353 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:19.349+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:19.349834+0000) 2021-08-03T13:17:19.369 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:19.363+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:19.364540+0000) 2021-08-03T13:17:19.798 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:19.792+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:19.793151+0000) 2021-08-03T13:17:19.835 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:19.829+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:19.830063+0000) 2021-08-03T13:17:20.064 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:19.901+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4395 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:20.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:20.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:20.251506+0000) 2021-08-03T13:17:20.358 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:20.353+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:20.354158+0000) 2021-08-03T13:17:20.370 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:20.364+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:20.365269+0000) 2021-08-03T13:17:21.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:21.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:21.251613+0000) 2021-08-03T13:17:21.360 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:21.355+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:21.356710+0000) 2021-08-03T13:17:21.370 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:21.365+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:21.365870+0000) 2021-08-03T13:17:21.675 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:21.654+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:21.716 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:21.710+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:21.711610+0000) 2021-08-03T13:17:21.725 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:21.718+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:21.719374+0000) 2021-08-03T13:17:22.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:22.250+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:22.251753+0000) 2021-08-03T13:17:22.361 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:22.356+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:22.357273+0000) 2021-08-03T13:17:22.371 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:22.365+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:22.366625+0000) 2021-08-03T13:17:22.671 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:22.665+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:22.665872+0000) 2021-08-03T13:17:22.721 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:22.697+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10457 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:23.021 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:23.012+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:23.012833+0000) 2021-08-03T13:17:23.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:23.251+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:23.251884+0000) 2021-08-03T13:17:23.372 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:23.366+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:23.367234+0000) 2021-08-03T13:17:24.023 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:24.017+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:24.018322+0000) 2021-08-03T13:17:24.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:24.251+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:24.252038+0000) 2021-08-03T13:17:24.372 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:24.367+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:24.367811+0000) 2021-08-03T13:17:24.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:24.632+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:24.633599+0000) 2021-08-03T13:17:25.023 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:25.018+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:25.018912+0000) 2021-08-03T13:17:25.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:25.251+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:25.252162+0000) 2021-08-03T13:17:25.373 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:25.367+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:25.368380+0000) 2021-08-03T13:17:25.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:25.632+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:25.633741+0000) 2021-08-03T13:17:25.664 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:25.658+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:25.659387+0000) 2021-08-03T13:17:26.024 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:26.018+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:26.019518+0000) 2021-08-03T13:17:26.025 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:26.019+0000 7f7877c8d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:26.020522+0000) 2021-08-03T13:17:26.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:26.251+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:26.252322+0000) 2021-08-03T13:17:26.376 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:26.368+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:26.368943+0000) 2021-08-03T13:17:26.637 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:26.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:26.633876+0000) 2021-08-03T13:17:26.756 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:26.749+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:26.750562+0000) 2021-08-03T13:17:26.896 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:26.729+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4415 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:27.025 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:27.019+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:27.020148+0000) 2021-08-03T13:17:27.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:27.251+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:27.252463+0000) 2021-08-03T13:17:27.376 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:27.371+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:27.371823+0000) 2021-08-03T13:17:27.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:27.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:27.634025+0000) 2021-08-03T13:17:28.025 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:28.020+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:28.020741+0000) 2021-08-03T13:17:28.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:28.251+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:28.252621+0000) 2021-08-03T13:17:28.377 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:28.371+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:28.372388+0000) 2021-08-03T13:17:28.470 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:28.464+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:28.465373+0000) 2021-08-03T13:17:28.543 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:28.505+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:28.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:28.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:28.634156+0000) 2021-08-03T13:17:29.252 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:29.247+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:29.247948+0000) 2021-08-03T13:17:29.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:29.251+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:29.252754+0000) 2021-08-03T13:17:29.378 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:29.372+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:29.372970+0000) 2021-08-03T13:17:29.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:29.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:29.634283+0000) 2021-08-03T13:17:30.140 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:30.133+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:30.134230+0000) 2021-08-03T13:17:30.256 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:30.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:30.252867+0000) 2021-08-03T13:17:30.378 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:30.372+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:30.373567+0000) 2021-08-03T13:17:30.578 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:30.571+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:30.573027+0000) 2021-08-03T13:17:30.595 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:30.590+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:30.591771+0000) 2021-08-03T13:17:30.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:30.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:30.634451+0000) 2021-08-03T13:17:30.677 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:30.574+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:31.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:31.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:31.252978+0000) 2021-08-03T13:17:31.379 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:31.373+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:31.374526+0000) 2021-08-03T13:17:31.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:31.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:31.634612+0000) 2021-08-03T13:17:32.250 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:32.245+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:32.246641+0000) 2021-08-03T13:17:32.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:32.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:32.253105+0000) 2021-08-03T13:17:32.380 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:32.374+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:32.375311+0000) 2021-08-03T13:17:32.428 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:32.422+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:32.423881+0000) 2021-08-03T13:17:32.638 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:32.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:32.634763+0000) 2021-08-03T13:17:33.253 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:33.248+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:33.249222+0000) 2021-08-03T13:17:33.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:33.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:33.253236+0000) 2021-08-03T13:17:33.382 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:33.375+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:33.376743+0000) 2021-08-03T13:17:33.407 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:33.402+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:33.404147+0000) 2021-08-03T13:17:33.430 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:33.424+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:33.425403+0000) 2021-08-03T13:17:33.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:33.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:33.634927+0000) 2021-08-03T13:17:34.255 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:34.251+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:34.251827+0000) 2021-08-03T13:17:34.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:34.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:34.253340+0000) 2021-08-03T13:17:34.382 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:34.376+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:34.377276+0000) 2021-08-03T13:17:34.431 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:34.425+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:34.426958+0000) 2021-08-03T13:17:34.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:34.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:34.635078+0000) 2021-08-03T13:17:34.811 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:34.803+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:34.805369+0000) 2021-08-03T13:17:34.952 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:34.910+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:34.911510+0000) 2021-08-03T13:17:35.038 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:34.980+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:35.093 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:35.087+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.088077+0000) 2021-08-03T13:17:35.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:35.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.253479+0000) 2021-08-03T13:17:35.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:35.253+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.254440+0000) 2021-08-03T13:17:35.382 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:35.377+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.377861+0000) 2021-08-03T13:17:35.433 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:35.426+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.428171+0000) 2021-08-03T13:17:35.525 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:35.519+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.521318+0000) 2021-08-03T13:17:35.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:35.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.635214+0000) 2021-08-03T13:17:35.917 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:35.911+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:35.912408+0000) 2021-08-03T13:17:36.092 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:36.087+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.088229+0000) 2021-08-03T13:17:36.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:36.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.253622+0000) 2021-08-03T13:17:36.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:36.254+0000 7f2544172700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.255016+0000) 2021-08-03T13:17:36.383 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:36.377+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.378399+0000) 2021-08-03T13:17:36.431 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:36.419+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4445 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:36.435 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:36.427+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.429615+0000) 2021-08-03T13:17:36.458 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:36.452+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.453227+0000) 2021-08-03T13:17:36.525 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:36.519+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.521468+0000) 2021-08-03T13:17:36.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:36.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.635401+0000) 2021-08-03T13:17:36.917 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:36.912+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:36.913101+0000) 2021-08-03T13:17:37.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:37.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.253738+0000) 2021-08-03T13:17:37.383 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:37.378+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.379071+0000) 2021-08-03T13:17:37.435 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:37.429+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.430775+0000) 2021-08-03T13:17:37.525 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:37.520+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.521602+0000) 2021-08-03T13:17:37.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:37.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.635556+0000) 2021-08-03T13:17:37.782 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:37.776+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.777272+0000) 2021-08-03T13:17:37.877 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:37.871+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.873585+0000) 2021-08-03T13:17:37.919 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:37.912+0000 23df4700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:37.913758+0000) 2021-08-03T13:17:37.944 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:37.739+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10471 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:38.257 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:38.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:38.253883+0000) 2021-08-03T13:17:38.384 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:38.378+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:38.379861+0000) 2021-08-03T13:17:38.436 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:38.430+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:38.431752+0000) 2021-08-03T13:17:38.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:38.633+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:38.635707+0000) 2021-08-03T13:17:38.821 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:38.816+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:38.817883+0000) 2021-08-03T13:17:39.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:39.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:39.254038+0000) 2021-08-03T13:17:39.385 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:39.378+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:39.380631+0000) 2021-08-03T13:17:39.438 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:39.432+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:39.433212+0000) 2021-08-03T13:17:39.639 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:39.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:39.635870+0000) 2021-08-03T13:17:39.863 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:39.855+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:39.857477+0000) 2021-08-03T13:17:40.044 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:40.035+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.036719+0000) 2021-08-03T13:17:40.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:40.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.254163+0000) 2021-08-03T13:17:40.386 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:40.379+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.381204+0000) 2021-08-03T13:17:40.439 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:40.433+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.434353+0000) 2021-08-03T13:17:40.557 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:40.552+0000 7f787748c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.553220+0000) 2021-08-03T13:17:40.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:40.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.636026+0000) 2021-08-03T13:17:40.649 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:40.642+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:40.723 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:40.716+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.717824+0000) 2021-08-03T13:17:40.884 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:40.876+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:40.878413+0000) 2021-08-03T13:17:41.193 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:41.186+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:41.187521+0000) 2021-08-03T13:17:41.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:41.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:41.254304+0000) 2021-08-03T13:17:41.386 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:41.380+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:41.381783+0000) 2021-08-03T13:17:41.440 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:41.435+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:41.435774+0000) 2021-08-03T13:17:41.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:41.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:41.636167+0000) 2021-08-03T13:17:42.109 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:42.103+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:42.104094+0000) 2021-08-03T13:17:42.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:42.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:42.254417+0000) 2021-08-03T13:17:42.365 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:42.359+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:42.360844+0000) 2021-08-03T13:17:42.386 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:42.380+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:42.382351+0000) 2021-08-03T13:17:42.442 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:42.436+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:42.436945+0000) 2021-08-03T13:17:42.541 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:42.431+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4452 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:42.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:42.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:42.636340+0000) 2021-08-03T13:17:42.722 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:42.715+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:42.716909+0000) 2021-08-03T13:17:43.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:43.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:43.254557+0000) 2021-08-03T13:17:43.366 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:43.359+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:43.361581+0000) 2021-08-03T13:17:43.387 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:43.381+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:43.383111+0000) 2021-08-03T13:17:43.443 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:43.437+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:43.438295+0000) 2021-08-03T13:17:43.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:43.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:43.636497+0000) 2021-08-03T13:17:43.722 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:43.716+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:43.717834+0000) 2021-08-03T13:17:44.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:44.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:44.254654+0000) 2021-08-03T13:17:44.367 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:44.360+0000 23c00700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:44.362204+0000) 2021-08-03T13:17:44.388 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:44.381+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:44.383692+0000) 2021-08-03T13:17:44.444 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:44.438+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:44.439474+0000) 2021-08-03T13:17:44.640 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:44.634+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:44.636663+0000) 2021-08-03T13:17:44.723 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:44.716+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:44.718412+0000) 2021-08-03T13:17:45.258 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:45.252+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:45.254787+0000) 2021-08-03T13:17:45.260 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:45.255+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:45.256328+0000) 2021-08-03T13:17:45.389 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:45.382+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:45.384282+0000) 2021-08-03T13:17:45.410 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:44.890+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10503 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:45.445 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:45.439+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:45.440717+0000) 2021-08-03T13:17:45.723 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:45.717+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:45.719046+0000) 2021-08-03T13:17:45.784 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:45.778+0000 7f254917c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:45.780556+0000) 2021-08-03T13:17:45.882 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:45.876+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:45.878728+0000) 2021-08-03T13:17:46.262 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:46.256+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:46.257343+0000) 2021-08-03T13:17:46.389 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:46.383+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:46.384861+0000) 2021-08-03T13:17:46.447 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:46.440+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:46.441634+0000) 2021-08-03T13:17:46.724 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:46.717+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:46.719604+0000) 2021-08-03T13:17:47.210 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:47.204+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:47.206283+0000) 2021-08-03T13:17:47.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:47.211+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:47.213613+0000) 2021-08-03T13:17:47.263 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:47.257+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:47.258219+0000) 2021-08-03T13:17:47.295 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:47.289+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:47.289866+0000) 2021-08-03T13:17:47.390 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:47.384+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:47.385541+0000) 2021-08-03T13:17:47.447 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:47.441+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:47.442561+0000) 2021-08-03T13:17:47.725 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:47.719+0000 233ae700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:47.720195+0000) 2021-08-03T13:17:48.158 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:48.152+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:48.153533+0000) 2021-08-03T13:17:48.174 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:47.904+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4458 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:48.218 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:48.212+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:48.213755+0000) 2021-08-03T13:17:48.263 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:48.258+0000 21def700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:48.258804+0000) 2021-08-03T13:17:48.271 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:48.266+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:48.267775+0000) 2021-08-03T13:17:48.288 INFO:tasks.ceph.osd.4.smithi101.stderr:2021-08-03T13:17:48.281+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:48.282293+0000) 2021-08-03T13:17:48.385 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:48.346+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:48.390 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:48.385+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:48.386108+0000) 2021-08-03T13:17:48.448 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:48.442+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:48.443485+0000) 2021-08-03T13:17:49.159 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:49.153+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:49.154323+0000) 2021-08-03T13:17:49.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:49.213+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:49.213910+0000) 2021-08-03T13:17:49.391 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:49.385+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:49.386677+0000) 2021-08-03T13:17:49.450 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:49.444+0000 223fd700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:49.444928+0000) 2021-08-03T13:17:49.746 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:49.740+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:49.740854+0000) 2021-08-03T13:17:49.759 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:49.754+0000 7f24e22b2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:49.755029+0000) 2021-08-03T13:17:50.159 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:50.154+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:50.155230+0000) 2021-08-03T13:17:50.217 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:50.213+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:50.214021+0000) 2021-08-03T13:17:50.504 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:50.496+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10523 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:50.537 INFO:tasks.ceph.osd.6.smithi101.stderr:2021-08-03T13:17:50.530+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:50.531211+0000) 2021-08-03T13:17:51.003 INFO:tasks.ceph.osd.5.smithi101.stderr:2021-08-03T13:17:50.997+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:50.997907+0000) 2021-08-03T13:17:51.160 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:51.155+0000 21bfc700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:51.155843+0000) 2021-08-03T13:17:51.218 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:51.213+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:51.214149+0000) 2021-08-03T13:17:51.468 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:51.463+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:51.464767+0000) 2021-08-03T13:17:51.590 INFO:tasks.ceph.osd.2.smithi003.stderr:2021-08-03T13:17:51.583+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:51.584483+0000) 2021-08-03T13:17:51.592 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:51.586+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:51.586763+0000) 2021-08-03T13:17:52.084 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:52.079+0000 7f254997d700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:52.080796+0000) 2021-08-03T13:17:52.218 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:52.213+0000 7f24da2a2700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:52.214275+0000) 2021-08-03T13:17:53.529 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:53.524+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:53.525773+0000) 2021-08-03T13:17:53.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:53.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:53.709634+0000) 2021-08-03T13:17:54.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:54.525+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:54.525905+0000) 2021-08-03T13:17:54.580 INFO:tasks.ceph.mon.b.smithi101.stderr:2021-08-03T13:17:54.410+0000 11e3d700 -1 mon.b@1(electing) e1 get_health_metrics reporting 4459 slow ops, oldest is monmgrreport(gid 4104, 1 checks, 0 progress events) 2021-08-03T13:17:54.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:54.708+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:54.709787+0000) 2021-08-03T13:17:55.130 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:55.125+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:55.125954+0000) 2021-08-03T13:17:55.133 INFO:tasks.ceph.osd.0.smithi003.stderr:2021-08-03T13:17:55.126+0000 d4c1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:55.127732+0000) 2021-08-03T13:17:55.530 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:55.525+0000 7f24e9ac1700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:55.526074+0000) 2021-08-03T13:17:55.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:55.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:55.709927+0000) 2021-08-03T13:17:55.909 INFO:tasks.ceph.osd.3.smithi003.stderr:2021-08-03T13:17:55.902+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:55.903588+0000) 2021-08-03T13:17:55.918 INFO:tasks.ceph.mon.a.smithi003.stderr:2021-08-03T13:17:55.913+0000 11e3d700 -1 mon.a@0(electing) e1 get_health_metrics reporting 10534 slow ops, oldest is mgrbeacon mgr.y(03d513f3-0a93-4a0d-ad7b-451d7864f99d,4101, , 0) 2021-08-03T13:17:55.982 INFO:tasks.ceph.mgr.x.smithi101.stderr:2021-08-03T13:17:55.977+0000 7f254a17e700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:55.977990+0000) 2021-08-03T13:17:56.109 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:56.103+0000 ccc0700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:56.104393+0000) 2021-08-03T13:17:56.713 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:56.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:56.710050+0000) 2021-08-03T13:17:56.764 INFO:tasks.ceph.mon.c.smithi003.stderr:2021-08-03T13:17:56.665+0000 11e3d700 -1 mon.c@2(electing) e1 get_health_metrics reporting 10459 slow ops, oldest is log(1 entries from seq 50 at 2021-08-03T10:58:52.227142+0000) 2021-08-03T13:17:56.765 INFO:tasks.ceph.osd.1.smithi003.stderr:2021-08-03T13:17:56.758+0000 c4bf700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:56.759245+0000) 2021-08-03T13:17:57.146 INFO:tasks.ceph.osd.7.smithi101.stderr:2021-08-03T13:17:57.139+0000 233ff700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:57.140241+0000) 2021-08-03T13:17:57.714 INFO:tasks.ceph.mgr.y.smithi003.stderr:2021-08-03T13:17:57.709+0000 7f7871c81700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2021-08-03T12:17:57.710188+0000) 2021-08-03T13:17:57.728 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-08-03T13:17:57.729 DEBUG:teuthology.task.console_log:Killing console logger for smithi003 2021-08-03T13:17:57.730 DEBUG:teuthology.task.console_log:Killing console logger for smithi101 2021-08-03T13:17:57.731 DEBUG:teuthology.exit:Finished running handlers